00000001:02000400:1.0F:1788642008.362575:0:2973:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_hostid 00000001:02000400:1.0:1788642027.344848:0:3195:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788642029.541215:0:3254:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 507 MB/s 00000001:01000000:2.0F:1788642029.793220:0:3254:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 539 MB/s 00000001:01000000:2.0:1788642030.043596:0:3254:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2935 MB/s 00000020:02000000:2.0:1788642031.209740:0:3286:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_3_ge47db3b 00000400:02000000:2.0:1788642032.491836:0:3301:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.149@tcp [8/256/0/180] 00008000:02000000:3.0:1788642036.440552:0:3451:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788642094.378991:0:5269:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788642104.204893:0:5841:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788642104.204969:0:5841:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788642104.205151:0:5841:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000731813e1 00000080:02000400:1.0:1788642104.205164:0:5841:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788642104.210591:0:5841:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788642104.210605:0:5841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788642104.210654:0:5841:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000fa6beea7) 00000020:00000080:1.0:1788642104.210680:0:5841:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788642104.224293:0:5841:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788642104.224658:0:5841:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788642104.242558:0:5841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788642104.242597:0:5841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788642104.242618:0:5841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788642104.242669:0:5841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788642104.242694:0:5841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788642104.243155:0:5841:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788642104.243165:0:5841:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788642104.243180:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666ce42 00000020:01000004:2.0:1788642104.243188:0:5841:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788642104.243194:0:5841:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788642104.243198:0:5841:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000731813e1 from MGS 00000020:01000004:2.0:1788642104.243203:0:5841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788642104.243236:0:5841:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000bb30107e) 00000020:00000080:2.0:1788642104.243247:0:5841:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788642104.243377:0:5841:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000731813e1 from MGS, refs=2 00080000:01000000:2.0:1788642104.243383:0:5841:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788642104.243389:0:5841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666ce50 00000100:00100000:2.0:1788642104.243504:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788642104.243644:0:5841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788642104.243651:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0F:1788642104.244325:0:5841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788642104.244337:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788642104.245025:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788642104.245290:0:5841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788642104.245296:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788642104.245789:0:5841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788642104.245796:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788642104.246239:0:5841:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788642104.246245:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788642104.246778:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642104.246781:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642104.246783:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642104.247082:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642104.247085:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642104.247086:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642104.247798:0:5841:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788642104.259042:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788642104.497294:0:5841:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4751 MB/s 00000001:01000000:0.0:1788642104.748158:0:5841:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4633 MB/s 00000001:01000000:2.0:1788642105.000087:0:5841:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 613 MB/s 00000001:01000000:2.0:1788642105.251011:0:5841:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 599 MB/s 00080000:10000000:3.0:1788642105.271906:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1788642105.275046:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788642105.288974:0:5841:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788642105.288998:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788642105.289002:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788642105.289919:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788642105.289983:0:5841:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788642105.290040:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788642105.290278:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788642105.290303:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788642105.290762:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788642105.290929:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788642105.290936:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788642105.291913:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788642105.291922:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788642105.295744:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788642105.295763:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788642105.304012:0:5841:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788642105.304038:0:5841:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.149@tcp' 00000020:01000004:0.0:1788642105.304040:0:5841:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788642105.304090:0:5841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.149@tcp (typ=mgc) 00000100:00080000:2.0:1788642105.304266:0:5857:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788642105.305493:0:5841:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.149@tcp (0000000049647d04) 00000020:00000080:0.0:1788642105.305522:0:5841:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788642105.305694:0:5841:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003fe54cf8@MGC192.168.202.149@tcp: add connection 192.168.202.149@tcp at head 00010000:00010000:0.0:1788642105.308045:0:5841:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.149@tcp-0 is initialized 00000040:01000000:0.0:1788642105.308058:0:5841:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788642105.311472:0:5858:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788642105.311588:0:5841:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.149@tcp (uuid ae59d524-c809-4baa-a38f-29c60bd72e4e) 00000020:00000080:0.0:1788642105.311612:0:5841:0:(genops.c:1385:class_connect()) connect: client ae59d524-c809-4baa-a38f-29c60bd72e4e, cookie 0x4ae1ee156666ce5e 00000100:00080000:0.0:1788642105.311624:0:5841:0:(import.c:545:import_select_connection()) MGC192.168.202.149@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788642105.311629:0:5841:0:(import.c:665:import_select_connection()) MGC192.168.202.149@tcp: import 000000003fe54cf8 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:0.0:1788642105.311680:0:5841:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d115f02b x1875527107346560/t0(0) o250->MGC192.168.202.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788642105.311713:0:5841:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ae59d524-c809-4baa-a38f-29c60bd72e4e->MGS 00000020:01000004:0.0:1788642105.312460:0:5841:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788642105.312470:0:5841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788642105.312488:0:5841:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f83a8325) 00000020:00000080:0.0:1788642105.312510:0:5841:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788642105.312959:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d115f02b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae59d524-c809-4baa-a38f-29c60bd72e4e:3316:1875527107346560:0@lo:250: 00000100:00100000:2.0:1788642105.313048:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642105.323680:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107346560 00000100:00100000:1.0:1788642105.323697:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107346560 00000100:00100000:1.0:1788642105.323743:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788642105.323749:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006020499e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3316:x1875527107346560:12345-0@lo:250: 00010000:00080000:1.0:1788642105.323776:0:5853:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ae59d524-c809-4baa-a38f-29c60bd72e4e@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:1.0:1788642105.323804:0:5853:0:(genops.c:1385:class_connect()) connect: client ae59d524-c809-4baa-a38f-29c60bd72e4e, cookie 0x4ae1ee156666ce6c 00000100:00080000:1.0:1788642105.323929:0:5853:0:(import.c:65:import_set_state_nolock()) 000000003edd5b5b : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788642105.324024:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006020499e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:3316:x1875527107346560:12345-0@lo:250: Request processed in 273us (10975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642105.324032:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788642105.324256:0:3316:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.149@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788642105.324266:0:3316:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.149@tcp: connect to target with instance 0 00000100:00080000:3.0:1788642105.324273:0:3316:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.149@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788642105.324277:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788642105.324280:0:3316:0:(import.c:65:import_set_state_nolock()) 000000003fe54cf8 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788642105.324282:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788642105.328236:0:3316:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788642105.328260:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d115f02b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae59d524-c809-4baa-a38f-29c60bd72e4e:3316:1875527107346560:0@lo:250: 00000100:00100000:0.0:1788642105.346869:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788642105.347447:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788642105.347454:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788642105.348826:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788642105.348837:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788642105.349476:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788642105.349552:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788642105.350539:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788642105.350818:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788642105.350825:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788642105.352460:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788642105.352472:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788642105.387436:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788642105.387671:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788642105.387678:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788642105.388796:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788642105.388805:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788642105.389556:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788642105.389750:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788642105.389755:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788642105.390363:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788642105.390372:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788642105.390935:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788642105.391254:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788642105.391261:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788642105.391710:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788642105.391718:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788642105.392404:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788642105.392587:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788642105.392593:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788642105.393040:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788642105.393047:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788642105.423992:0:5841:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788642105.424361:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788642105.424370:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788642105.427970:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788642105.427989:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788642105.433624:0:5841:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788642105.433649:0:5841:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788642105.439538:0:5841:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788642105.439581:0:5841:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788642105.439589:0:5841:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.149@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788642105.440045:0:5841:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788642105.440089:0:5841:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.149@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788642105.440093:0:5841:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788642105.440095:0:5841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788642105.440302:0:5841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788642105.440304:0:5841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788642105.440305:0:5841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788642105.440306:0:5841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788642105.440307:0:5841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788642105.440309:0:5841:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788642105.440310:0:5841:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788642105.440311:0:5841:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788642105.440313:0:5841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788642105.440314:0:5841:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788642105.440317:0:5841:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788642105.440319:0:5841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788642105.440320:0:5841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788642105.440321:0:5841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788642105.440322:0:5841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788642105.440323:0:5841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788642105.440324:0:5841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788642105.440333:0:5841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788642105.440333:0:5841:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788642105.440334:0:5841:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788642105.440335:0:5841:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788642105.440336:0:5841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788642105.440337:0:5841:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788642105.446943:0:5841:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788642105.446966:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016d95dba pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107346688:0@lo:253: 00000100:00100000:1.0:1788642105.447052:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642105.447126:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000026fd7f7b going to sleep for 11 seconds 00000100:00100000:0.0:1788642105.447304:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107346688 00000100:00100000:0.0:1788642105.447314:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107346688 00000100:00100000:0.0:1788642105.447366:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788642105.447375:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006eb7ddd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:5841:x1875527107346688:12345-0@lo:253: 20000000:01000000:0.0:1788642105.447422:0:5856:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788642105.447424:0:5856:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788642105.447761:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788642105.447826:0:5856:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788642105.448195:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788642105.449295:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788642105.449475:0:5856:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788642105.449480:0:5856:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788642105.449485:0:5856:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788642105.449488:0:5856:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788642105.449503:0:5856:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788642105.449660:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788642105.449861:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788642105.449874:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788642105.449921:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788642105.449979:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788642105.450017:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788642105.450337:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788642105.450349:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788642105.450418:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788642105.450426:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788642105.450459:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788642105.450466:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788642105.450495:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788642105.450539:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788642105.450581:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788642105.450587:0:5856:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788642105.450600:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788642105.450772:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788642105.450782:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788642105.450818:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788642105.450851:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788642105.450892:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788642105.450903:0:5856:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788642105.450976:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788642105.450985:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788642105.451028:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788642105.451063:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788642105.451470:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788642105.451485:0:5856:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788642105.451572:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788642105.451582:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788642105.451615:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788642105.451649:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788642105.451829:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788642105.451877:0:5856:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788642105.451884:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788642105.458270:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788642105.459174:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788642105.459222:0:5856:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.149@tcp for mdt 20000000:01000000:0.0:1788642105.459225:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.149@tcp (null) (null) (null) 00000040:00080000:0.0:1788642105.459288:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788642105.459297:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788642105.459332:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788642105.459339:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.149@tcp (null) (null) 00000040:00080000:0.0:1788642105.459382:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788642105.459394:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788642105.459424:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788642105.459464:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788642105.459527:0:5856:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788642105.459530:0:5856:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788642105.459534:0:5856:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788642105.459554:0:5856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788642105.459557:0:5856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788642105.459585:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788642105.459587:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788642105.461710:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788642105.467854:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788642105.467903:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788642105.467935:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788642105.467948:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788642105.467950:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788642105.473068:0:5881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788642105.477437:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788642105.477491:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788642105.477562:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1788642105.477583:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788642105.477585:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788642105.477591:0:5856:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788642105.477593:0:5856:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788642105.477599:0:5856:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788642105.477605:0:5856:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788642105.479799:0:5882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788642105.479979:0:5856:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788642105.489056:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788642105.489346:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788642105.489424:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788642105.489447:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788642105.489466:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000087dc72f4/0x4ae1ee156666ce73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.489482:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087dc72f4/0x4ae1ee156666ce73 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.489509:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000087dc72f4/0x4ae1ee156666ce73 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.489514:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000087dc72f4/0x4ae1ee156666ce73 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.489520:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000087dc72f4/0x4ae1ee156666ce73 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.489526:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000087dc72f4/0x4ae1ee156666ce73 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.489532:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000087dc72f4 already unused, calling callback (00000000f101c8ce) 00010000:00010000:2.0:1788642105.489535:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000087dc72f4/0x4ae1ee156666ce73 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.489541:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000087dc72f4/0x4ae1ee156666ce73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.489554:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000087dc72f4/0x4ae1ee156666ce73 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.489561:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000087dc72f4/0x4ae1ee156666ce73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.489565:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000087dc72f4/0x4ae1ee156666ce73 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788642105.489582:0:5856:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788642105.719242:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006eb7ddd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:5841:x1875527107346688:12345-0@lo:253: Request processed in 271860us (272181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642105.719269:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788642105.719362:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016d95dba pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107346688:0@lo:253: 10000000:01000000:1.0:1788642105.719381:0:5841:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788642105.719385:0:5841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788642105.719387:0:5841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788642105.719388:0:5841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788642105.719389:0:5841:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788642105.719390:0:5841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788642105.719391:0:5841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788642105.719392:0:5841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788642105.719393:0:5841:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788642105.719395:0:5841:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788642105.719396:0:5841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788642105.719397:0:5841:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788642105.719419:0:5841:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000731813e1 from lustre-MDT0000 10000000:01000000:1.0:1788642105.719447:0:5841:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788642105.719450:0:5841:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788642105.719455:0:5841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8dddc4e04d40 10000000:01000000:1.0:1788642105.719460:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788642105.719469:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dddc4e04d40 from 1 10000000:01000000:1.0:1788642105.719473:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788642105.719534:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 00000000ac61117b/0x4ae1ee156666ce7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642105.719545:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 00000000ac61117b/0x4ae1ee156666ce7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642105.719554:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 00000000ac61117b/0x4ae1ee156666ce7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642105.719572:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016d95dba pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107346816:0@lo:101: 00000100:00100000:1.0:1788642105.719606:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642105.719715:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b259703e going to sleep for 11 seconds 00000100:00100000:3.0:1788642105.719880:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107346816 00000100:00100000:3.0:1788642105.719887:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107346816 00000100:00100000:3.0:1788642105.719989:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788642105.719998:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8456115 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:5841:x1875527107346816:12345-0@lo:101: 00010000:00010000:3.0:1788642105.720011:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642105.720026:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c41e9f0d/0x4ae1ee156666ce81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666ce7a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642105.720048:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c41e9f0d/0x4ae1ee156666ce81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666ce7a expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642105.720058:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c41e9f0d/0x4ae1ee156666ce81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666ce7a expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642105.720067:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c41e9f0d, rc 0) 00000100:00100000:3.0:1788642105.720143:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8456115 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+6:5841:x1875527107346816:12345-0@lo:101: Request processed in 146us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642105.720151:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642105.720256:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016d95dba pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107346816:0@lo:101: 00010000:00010000:0.0:1788642105.720272:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 00000000ac61117b/0x4ae1ee156666ce7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642105.720283:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 00000000ac61117b/0x4ae1ee156666ce7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642105.720344:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008536e211 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107346944:0@lo:501: 00000100:00100000:0.0:1788642105.720387:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642105.720495:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f1998e8 going to sleep for 11 seconds 00000100:00100000:1.0:1788642105.720581:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107346944 00000100:00100000:1.0:1788642105.720585:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107346944 00000100:00100000:1.0:1788642105.720607:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788642105.720613:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aebf7d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+6:5841:x1875527107346944:12345-0@lo:501: 00000100:00100000:1.0:1788642105.721023:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aebf7d57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+6:5841:x1875527107346944:12345-0@lo:501: Request processed in 408us (634us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788642105.721030:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788642105.721198:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008536e211 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107346944:0@lo:501: 10000000:01000000:2.0:1788642105.721309:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788642105.721372:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 00000000ac61117b/0x4ae1ee156666ce7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.721390:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 00000000ac61117b/0x4ae1ee156666ce7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788642105.721399:0:5841:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dddc599b800 10000000:01000000:2.0:1788642105.721404:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788642105.721409:0:5841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dddc599b800 10000000:01000000:2.0:1788642105.721412:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788642105.721415:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dddc599b800 from 1 10000000:01000000:2.0:1788642105.721417:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788642105.721455:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 0000000087dc72f4/0x4ae1ee156666ce88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.721463:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 0000000087dc72f4/0x4ae1ee156666ce88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.721472:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 0000000087dc72f4/0x4ae1ee156666ce88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642105.721490:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107347072:0@lo:101: 00000100:00100000:2.0:1788642105.721527:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642105.721560:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000009979ff24 going to sleep for 11 seconds 00000100:00100000:1.0:1788642105.721614:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107347072 00000100:00100000:1.0:1788642105.721620:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107347072 00000100:00100000:1.0:1788642105.721659:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788642105.721666:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d56baa02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+6:5841:x1875527107347072:12345-0@lo:101: 00010000:00010000:1.0:1788642105.721677:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642105.721693:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000271468fd/0x4ae1ee156666ce8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666ce88 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642105.721717:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000271468fd/0x4ae1ee156666ce8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666ce88 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642105.721741:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000271468fd/0x4ae1ee156666ce8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666ce88 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642105.721751:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000271468fd, rc 0) 00000100:00100000:1.0:1788642105.721783:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d56baa02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+7:5841:x1875527107347072:12345-0@lo:101: Request processed in 118us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642105.721789:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788642105.721936:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107347072:0@lo:101: 00010000:00010000:2.0:1788642105.721948:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 0000000087dc72f4/0x4ae1ee156666ce88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.721954:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 0000000087dc72f4/0x4ae1ee156666ce88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788642105.721978:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788642105.722067:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 0000000087dc72f4/0x4ae1ee156666ce88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.722075:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 0000000087dc72f4/0x4ae1ee156666ce88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788642105.722081:0:5841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788642105.722085:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788642105.722090:0:5841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dddc599b800 10000000:01000000:2.0:1788642105.722092:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788642105.722095:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788642105.722125:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788642105.722141:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 0000000052624dc7/0x4ae1ee156666ce96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.722148:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 0000000052624dc7/0x4ae1ee156666ce96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.722154:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 0000000052624dc7/0x4ae1ee156666ce96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642105.722173:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107347200:0@lo:101: 00000100:00100000:2.0:1788642105.722201:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642105.722223:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000009979ff24 going to sleep for 11 seconds 00000100:00100000:0.0:1788642105.722285:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107347200 00000100:00100000:0.0:1788642105.722291:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107347200 00000100:00100000:0.0:1788642105.722322:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788642105.722329:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075ab2a6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+7:5841:x1875527107347200:12345-0@lo:101: 00010000:00010000:0.0:1788642105.722336:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642105.722348:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f98a938a/0x4ae1ee156666ce9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666ce96 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642105.722374:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f98a938a/0x4ae1ee156666ce9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666ce96 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642105.722382:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f98a938a/0x4ae1ee156666ce9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666ce96 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642105.722388:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f98a938a, rc 0) 00000100:00100000:0.0:1788642105.722429:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075ab2a6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+8:5841:x1875527107347200:12345-0@lo:101: Request processed in 101us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642105.722435:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788642105.722511:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107347200:0@lo:101: 00010000:00010000:2.0:1788642105.722521:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 0000000052624dc7/0x4ae1ee156666ce96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ce9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642105.722540:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 0000000052624dc7/0x4ae1ee156666ce96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666ce9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642105.722598:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107347328:0@lo:501: 00000100:00100000:2.0:1788642105.722623:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642105.722645:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000009979ff24 going to sleep for 11 seconds 00000100:00100000:0.0:1788642105.722702:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107347328 00000100:00100000:0.0:1788642105.722707:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107347328 00000100:00100000:0.0:1788642105.722735:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788642105.722741:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ce5c368 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+8:5841:x1875527107347328:12345-0@lo:501: 00000100:00100000:0.0:1788642105.723341:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ce5c368 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+9:5841:x1875527107347328:12345-0@lo:501: Request processed in 599us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642105.723348:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788642105.723447:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107347328:0@lo:501: 00000100:00100000:2.0:1788642105.723479:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107347456:0@lo:503: 00000100:00100000:2.0:1788642105.723517:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642105.723581:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000009979ff24 going to sleep for 11 seconds 00000100:00100000:0.0:1788642105.723617:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107347456 00000100:00100000:0.0:1788642105.723623:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107347456 00000100:00100000:0.0:1788642105.723687:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788642105.723694:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098458e64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+9:5841:x1875527107347456:12345-0@lo:503: 00000100:00100000:0.0:1788642105.723859:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098458e64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+9:5841:x1875527107347456:12345-0@lo:503: Request processed in 165us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642105.723865:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788642105.723932:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107347456:0@lo:503: 00000100:00100000:2.0:1788642105.724469:0:5884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:5884:1875527107347584:0@lo:502: 00000100:00100000:2.0:1788642105.724510:0:5884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642105.724644:0:5884:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ed5af6b going to sleep for 11 seconds 00000100:00100000:1.0:1788642105.724678:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107347584 00000100:00100000:1.0:1788642105.724684:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107347584 00000100:00100000:1.0:1788642105.724710:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788642105.724717:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000351566d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+9:5884:x1875527107347584:12345-0@lo:502: 00000100:00100000:1.0:1788642105.724945:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000351566d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+9:5884:x1875527107347584:12345-0@lo:502: Request processed in 228us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642105.724952:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788642105.725075:0:5884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:5884:1875527107347584:0@lo:502: 00000020:01000000:2.0:1788642105.725199:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788642105.725211:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642105.725213:0:5884:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788642105.725218:0:5884:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788642105.725221:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788642105.725234:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000002d0a6af) 00000020:00000080:2.0:1788642105.725257:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788642105.725264:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788642105.725346:0:5884:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788642105.725354:0:5884:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666ceab 00000020:00000080:2.0:1788642105.725599:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788642105.725609:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642105.725612:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642105.725613:0:5884:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788642105.725616:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788642105.725619:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642105.725620:0:5884:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788642105.725622:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788642105.725629:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c8d2041a) 00000020:00000080:2.0:1788642105.725638:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788642105.725641:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788642105.725642:0:5884:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788642105.725644:0:5884:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788642105.725650:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788642105.725704:0:5884:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000731813e1 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788642105.725715:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000068620800) 00000020:00000080:2.0:1788642105.725723:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788642105.725774:0:5884:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788642105.725780:0:5884:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4ae1ee156666cec0 00000020:00000080:2.0:1788642105.726040:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788642105.726047:0:5884:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788642105.726051:0:5884:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4ae1ee156666cec7 00080000:01000000:2.0:1788642105.726056:0:5884:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788642105.726059:0:5884:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666cece 00080000:10000000:2.0:1788642105.726509:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788642105.726704:0:5884:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788642105.732530:0:5884:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788642105.789593:0:5884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788642105.789986:0:5884:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788642105.792577:0:5884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788642105.793026:0:5884:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788642105.821494:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000107e716c) 00000020:00000080:3.0:1788642105.821516:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788642105.821580:0:5884:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788642105.821587:0:5884:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666cedc 00000020:00000080:2.0:1788642105.826004:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788642105.827404:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788642105.860403:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788642105.888567:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788642105.916367:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788642105.952496:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788642105.988539:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788642106.015378:0:5884:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4ae1ee156666cee3 00000020:00000080:1.0:1788642106.015945:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788642106.015957:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642106.015963:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642106.015965:0:5884:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788642106.015968:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788642106.015972:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642106.015973:0:5884:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788642106.015977:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788642106.015978:0:5884:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788642106.015981:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642106.015983:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642106.015984:0:5884:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788642106.015987:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788642106.015991:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642106.015992:0:5884:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788642106.016004:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788642106.016044:0:5884:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788642106.016129:0:5884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000068acc820 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:5884:1875527107347712:0@lo:502: 00000100:00100000:1.0:1788642106.016223:0:5884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642106.016426:0:5884:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089420ed4 going to sleep for 11 seconds 00000100:00100000:2.0:1788642106.016537:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107347712 00000100:00100000:2.0:1788642106.016545:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107347712 00000100:00100000:2.0:1788642106.016624:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788642106.016634:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1be0e77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+9:5884:x1875527107347712:12345-0@lo:502: 00000100:00100000:2.0:1788642106.017179:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1be0e77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+9:5884:x1875527107347712:12345-0@lo:502: Request processed in 545us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642106.017188:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788642106.017281:0:5884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000068acc820 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:5884:1875527107347712:0@lo:502: 00000020:01000000:0.0:1788642106.017323:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642106.017329:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642106.017331:0:5884:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788642106.017335:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788642106.017512:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788642106.017530:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788642106.017552:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 0000000052624dc7/0x4ae1ee156666ce96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ce9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.017562:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 0000000052624dc7/0x4ae1ee156666ce96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ce9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642106.017570:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dddc599b800 from 1 10000000:01000000:3.0:1788642106.017572:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788642106.017620:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.017628:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.017637:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642106.017659:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107347840:0@lo:101: 00000100:00100000:3.0:1788642106.017698:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642106.017940:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000846d225b going to sleep for 11 seconds 00000100:00100000:2.0:1788642106.018020:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107347840 00000100:00100000:2.0:1788642106.018028:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107347840 00000100:00100000:2.0:1788642106.018061:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788642106.018068:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009201aa18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+9:5841:x1875527107347840:12345-0@lo:101: 00010000:00010000:2.0:1788642106.018081:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642106.018214:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000066d9344/0x4ae1ee156666cef1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666ceea expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642106.018242:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000066d9344/0x4ae1ee156666cef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666ceea expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642106.018253:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000066d9344/0x4ae1ee156666cef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666ceea expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642106.018260:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000066d9344, rc 0) 00000100:00100000:2.0:1788642106.018293:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009201aa18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+10:5841:x1875527107347840:12345-0@lo:101: Request processed in 227us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642106.018300:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788642106.018400:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107347840:0@lo:101: 00010000:00010000:3.0:1788642106.018414:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.018434:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666cef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642106.019026:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107347968:0@lo:256: 00000100:00100000:3.0:1788642106.019074:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642106.019133:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000846d225b going to sleep for 11 seconds 00000100:00100000:2.0:1788642106.019272:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107347968 00000100:00100000:2.0:1788642106.019277:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107347968 00000100:00100000:2.0:1788642106.019305:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788642106.019312:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5d7c575 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+10:5841:x1875527107347968:12345-0@lo:256: 20000000:01000000:2.0:1788642106.019337:0:5854:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788642106.019343:0:5854:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788642106.019428:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5d7c575 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+10:5841:x1875527107347968:12345-0@lo:256: Request processed in 116us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642106.019435:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788642106.019518:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107347968:0@lo:256: 10000000:01000000:3.0:1788642106.020161:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788642106.020179:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.020190:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642106.020198:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddc599b800 from 1 10000000:01000000:3.0:1788642106.020200:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788642106.020233:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.020239:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.020247:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642106.020264:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107348096:0@lo:101: 00000100:00100000:3.0:1788642106.020311:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642106.020348:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000846d225b going to sleep for 11 seconds 00000100:00100000:2.0:1788642106.020517:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107348096 00000100:00100000:2.0:1788642106.020524:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107348096 00000100:00100000:2.0:1788642106.020551:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788642106.020557:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5dd5087 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+10:5841:x1875527107348096:12345-0@lo:101: 00010000:00010000:2.0:1788642106.020568:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642106.020583:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071762ee6/0x4ae1ee156666ceff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666cef8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642106.020604:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071762ee6/0x4ae1ee156666ceff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666cef8 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642106.020614:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071762ee6/0x4ae1ee156666ceff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cef8 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642106.020623:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071762ee6, rc 0) 00000100:00100000:2.0:1788642106.020665:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5dd5087 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:5841:x1875527107348096:12345-0@lo:101: Request processed in 108us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642106.020672:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788642106.020755:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107348096:0@lo:101: 00010000:00010000:3.0:1788642106.020767:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ceff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.020835:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666ceff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642106.020900:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107348224:0@lo:501: 00000100:00100000:3.0:1788642106.020926:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642106.021044:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000846d225b going to sleep for 11 seconds 00000100:00100000:1.0:1788642106.021187:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107348224 00000100:00100000:1.0:1788642106.021192:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107348224 00000100:00100000:1.0:1788642106.021216:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788642106.021222:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb56c71c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:5841:x1875527107348224:12345-0@lo:501: 00000100:00100000:1.0:1788642106.021704:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb56c71c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:5841:x1875527107348224:12345-0@lo:501: Request processed in 481us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642106.021711:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788642106.021822:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107348224:0@lo:501: 00000100:00100000:3.0:1788642106.021852:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107348352:0@lo:503: 00000100:00100000:3.0:1788642106.021889:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642106.021920:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 00000000846d225b going to sleep for 11 seconds 00000100:00100000:1.0:1788642106.022018:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107348352 00000100:00100000:1.0:1788642106.022023:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107348352 00000100:00100000:1.0:1788642106.022042:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788642106.022047:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000587fb05e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:5841:x1875527107348352:12345-0@lo:503: 00000040:00080000:1.0:1788642106.022082:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788642106.022168:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000587fb05e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:5841:x1875527107348352:12345-0@lo:503: Request processed in 120us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642106.022175:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788642106.022265:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107348352:0@lo:503: 00000040:00080000:0.0:1788642106.023421:0:5888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788642106.023620:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788642106.023646:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788642106.023707:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ceff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.023718:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ceff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642106.023767:0:5841:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788642106.023770:0:5841:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dddc599b800 10000000:01000000:3.0:1788642106.023773:0:5841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dddc599b800 10000000:01000000:3.0:1788642106.023856:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788642106.023873:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dddc599b800 from 1 10000000:01000000:3.0:1788642106.023875:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788642106.023907:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 00000000ecfaff03/0x4ae1ee156666cf06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.023916:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 00000000ecfaff03/0x4ae1ee156666cf06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.023925:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 00000000ecfaff03/0x4ae1ee156666cf06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642106.023942:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107348480:0@lo:101: 00000100:00100000:3.0:1788642106.024000:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642106.024081:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017902be4 going to sleep for 11 seconds 00000100:00100000:1.0:1788642106.024579:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107348480 00000100:00100000:1.0:1788642106.024589:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107348480 00000100:00100000:0.0:1788642106.024754:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788642106.024764:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a535b7d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:5841:x1875527107348480:12345-0@lo:101: 00010000:00010000:0.0:1788642106.024792:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642106.024808:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001aea84d7/0x4ae1ee156666cf0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666cf06 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642106.024835:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001aea84d7/0x4ae1ee156666cf0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666cf06 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642106.024846:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001aea84d7/0x4ae1ee156666cf0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cf06 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642106.024855:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001aea84d7, rc 0) 00000100:00100000:0.0:1788642106.024923:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a535b7d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5841:x1875527107348480:12345-0@lo:101: Request processed in 161us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642106.024930:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788642106.025018:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107348480:0@lo:101: 00010000:00010000:3.0:1788642106.025033:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 00000000ecfaff03/0x4ae1ee156666cf06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.025041:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 00000000ecfaff03/0x4ae1ee156666cf06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666cf0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642106.025128:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107348608:0@lo:501: 00000100:00100000:3.0:1788642106.025168:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642106.025506:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017902be4 going to sleep for 11 seconds 00000100:00100000:2.0:1788642106.025588:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107348608 00000100:00100000:2.0:1788642106.025594:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107348608 00000100:00100000:2.0:1788642106.025620:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788642106.025625:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5c771a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5841:x1875527107348608:12345-0@lo:501: 00000100:00100000:2.0:1788642106.025998:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5c771a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5841:x1875527107348608:12345-0@lo:501: Request processed in 372us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642106.026012:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788642106.026126:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107348608:0@lo:501: 00000100:00100000:3.0:1788642106.026172:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107348736:0@lo:503: 00000100:00100000:3.0:1788642106.026215:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642106.026228:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017902be4 going to sleep for 11 seconds 00000100:00100000:2.0:1788642106.026291:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107348736 00000100:00100000:2.0:1788642106.026296:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107348736 00000100:00100000:2.0:1788642106.026316:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788642106.026321:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e12fea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5841:x1875527107348736:12345-0@lo:503: 00000100:00100000:2.0:1788642106.026663:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e12fea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5841:x1875527107348736:12345-0@lo:503: Request processed in 341us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642106.026670:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788642106.026755:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107348736:0@lo:503: 00000100:00100000:3.0:1788642106.027382:0:5889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:5889:1875527107348864:0@lo:502: 00000100:00100000:3.0:1788642106.027427:0:5889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642106.027459:0:5889:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b0d88df going to sleep for 11 seconds 00000100:00100000:2.0:1788642106.027510:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107348864 00000100:00100000:2.0:1788642106.027516:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107348864 00000100:00100000:2.0:1788642106.027551:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788642106.027558:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2530b04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5889:x1875527107348864:12345-0@lo:502: 00000100:00100000:2.0:1788642106.027770:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2530b04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5889:x1875527107348864:12345-0@lo:502: Request processed in 213us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642106.027787:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788642106.027825:0:5889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba699587 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:5889:1875527107348864:0@lo:502: 00000020:01000004:2.0:1788642106.027881:0:5889:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788642106.027904:0:5889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000017aa7edd) 00000020:00000080:2.0:1788642106.027925:0:5889:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788642106.027993:0:5889:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000731813e1 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788642106.027997:0:5889:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000731813e1 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788642106.027999:0:5889:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000731813e1 4 00010000:00080000:2.0:1788642106.028032:0:5889:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001a2b0fd7@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.149@tcp at head 00010000:00010000:2.0:1788642106.029661:0:5889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788642106.032640:0:5889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788642106.032693:0:5889:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788642106.032710:0:5889:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4ae1ee156666cf1b 00000100:00080000:2.0:1788642106.032727:0:5889:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788642106.032732:0:5889:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001a2b0fd7 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788642106.032771:0:5889:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b00b868f x1875527107348992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788642106.032873:0:5889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788642106.033209:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875527107348992:0@lo:38: 00000100:00100000:3.0:1788642106.033309:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642106.033458:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107348992 00000100:00100000:2.0:1788642106.033466:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107348992 00000100:00100000:2.0:1788642106.033512:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788642106.033520:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002309a348 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3316:x1875527107348992:12345-0@lo:38: 00000100:00100000:2.0:1788642106.033593:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002309a348 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3316:x1875527107348992:12345-0@lo:38: Request processed in 73us (284us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788642106.033599:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788642106.033641:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788642106.033650:0:3316:0:(import.c:65:import_set_state_nolock()) 000000001a2b0fd7 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788642106.033654:0:3316:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788642106.033657:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875527107348992:0@lo:38: 00000100:00100000:2.0:1788642106.033744:0:5889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:5889:1875527107349120:0@lo:502: 00000100:00100000:2.0:1788642106.033914:0:5889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642106.033976:0:5889:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d051782 going to sleep for 11 seconds 00000100:00100000:3.0:1788642106.038251:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107349120 00000100:00100000:3.0:1788642106.038276:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107349120 00000100:00100000:2.0:1788642106.038545:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788642106.038559:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062a421ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5889:x1875527107349120:12345-0@lo:502: 00000100:00100000:2.0:1788642106.039008:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062a421ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5889:x1875527107349120:12345-0@lo:502: Request processed in 450us (5093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642106.039017:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788642106.039091:0:5889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:5889:1875527107349120:0@lo:502: 00000040:00080000:2.0:1788642106.039165:0:5889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788642106.039246:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788642106.039265:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788642106.039280:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 00000000ecfaff03/0x4ae1ee156666cf06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642106.039290:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 00000000ecfaff03/0x4ae1ee156666cf06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788642106.039332:0:5841:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788642106.039334:0:5841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788642106.039335:0:5841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788642106.039337:0:5841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788642106.039338:0:5841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788642106.039339:0:5841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788642106.039340:0:5841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788642106.039341:0:5841:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788642106.039342:0:5841:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788642106.039343:0:5841:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788642106.039345:0:5841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788642106.039346:0:5841:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788642106.039350:0:5841:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788642106.039352:0:5841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788642106.039353:0:5841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788642106.039354:0:5841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788642106.039355:0:5841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788642106.039356:0:5841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788642106.039357:0:5841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788642106.039358:0:5841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788642106.039358:0:5841:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788642106.039359:0:5841:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788642106.039360:0:5841:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788642106.039361:0:5841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788642106.039361:0:5841:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788642106.039386:0:5841:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788642106.039400:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107349248:0@lo:253: 00000100:00100000:2.0:1788642106.039443:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642106.039485:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d051782 going to sleep for 11 seconds 00000100:00100000:1.0:1788642106.040669:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107349248 00000100:00100000:1.0:1788642106.040688:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107349248 00000100:00100000:1.0:1788642106.040752:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788642106.040762:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000453a3faa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5841:x1875527107349248:12345-0@lo:253: 20000000:01000000:1.0:1788642106.040871:0:5854:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788642106.040886:0:5854:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788642106.076019:0:5854:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788642106.076085:0:5854:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788642106.076288:0:5877:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788642106.076294:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788642106.076315:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.076333:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000066d9344/0x4ae1ee156666cef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666ceea expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.076342:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.076381:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000066d9344/0x4ae1ee156666cef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666ceea expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.076397:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000066d9344/0x4ae1ee156666cef1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666ceea expref: 12 pid: 5854 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642106.076411:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000045f7c296 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1875527107349376:0@lo:104: 00000100:00100000:3.0:1788642106.076477:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642106.076536:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc20e9b6 going to sleep for 11 seconds 00000100:00100000:1.0:1788642106.076603:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107349376 00000100:00100000:1.0:1788642106.076611:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107349376 00000100:00100000:1.0:1788642106.076660:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788642106.076668:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d14fd0eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5877:x1875527107349376:12345-0@lo:104: 00010000:00010000:1.0:1788642106.076681:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642106.076730:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788642106.076736:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d14fd0eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5877:x1875527107349376:12345-0@lo:104: Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642106.076742:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788642106.076885:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642106.076890:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.076905:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f4f12cc1 already unused, calling callback (000000005615ff68) 10000000:00010000:3.0:1788642106.076908:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666cef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.076914:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666cef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788642106.076919:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666cef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642106.076924:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788642106.076958:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.076964:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642106.076991:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.076997:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: 00000000f4f12cc1/0x4ae1ee156666ceea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077013:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642106.077015:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642106.077016:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642106.077040:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000045f7c296 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1875527107349376:0@lo:104: 00010000:00010000:3.0:1788642106.077059:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642106.077229:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000939c71fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107349504:0@lo:103: 00000100:00100000:1.0:1788642106.077259:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642106.077363:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107349504 00000100:00100000:3.0:1788642106.077371:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107349504 00010000:00010000:3.0:1788642106.077390:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000066d9344/0x4ae1ee156666cef1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666ceea expref: 13 pid: 5854 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642106.077419:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788642106.077426:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2587643 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:3318:x1875527107349504:12345-0@lo:103: 00010000:00010000:3.0:1788642106.077437:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642106.077440:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000066d9344/0x4ae1ee156666cef1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666ceea expref: 13 pid: 5854 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077449:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000066d9344/0x4ae1ee156666cef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666ceea expref: 13 pid: 5854 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077461:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000066d9344/0x4ae1ee156666cef1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666ceea expref: 13 pid: 5854 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077473:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077480:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788642106.077492:0:5845:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001198774s 00010000:00010000:3.0:1788642106.077495:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077501:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077506:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077521:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077527:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a926890b already unused, calling callback (00000000f101c8ce) 00010000:00010000:3.0:1788642106.077530:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077536:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077550:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077559:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642106.077588:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2587643 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:3318:x1875527107349504:12345-0@lo:103: Request processed in 163us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642106.077594:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788642106.077619:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000939c71fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107349504:0@lo:103: 00010000:00010000:3.0:1788642106.077634:0:5877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077640:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642106.077645:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a926890b/0x4ae1ee156666cf22 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642106.084824:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000453a3faa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:5841:x1875527107349248:12345-0@lo:253: Request processed in 44052us (45369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642106.084849:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788642106.085016:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b00b868f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:5841:1875527107349248:0@lo:253: 10000000:01000000:0.0:1788642106.085036:0:5841:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788642106.085040:0:5841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788642106.085042:0:5841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788642106.085044:0:5841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788642106.085045:0:5841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788642106.085046:0:5841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788642106.085047:0:5841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788642106.085048:0:5841:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788642106.085064:0:5841:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788642106.085066:0:5841:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788642106.085067:0:5841:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788642106.085069:0:5841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788642106.085070:0:5841:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788642106.085089:0:5841:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788642106.090730:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788642106.091197:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788642106.091422:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788642106.091592:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788642106.091888:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788642106.092077:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788642106.093168:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788642106.093357:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788642106.093714:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788642106.093962:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788642106.094292:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788642106.094464:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788642106.127258:0:5841:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788642106.153169:0:5841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788642106.153444:0:5895:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788642106.157796:0:5841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788642106.158012:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788642106.160578:0:5894:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788642106.160589:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:3.0:1788642106.163700:0:5841:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788642106.164193:0:5841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788642106.164524:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788642106.165628:0:5841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788642106.166313:0:5841:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788642106.167345:0:5841:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788642106.167706:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788642106.167961:0:5841:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788642106.169456:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788642106.169612:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788642106.169768:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788642106.169933:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788642106.170088:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788642106.176893:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788642106.177080:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788642106.177507:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788642106.177663:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788642106.177910:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788642106.178068:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788642106.178252:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788642106.178399:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788642106.178579:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788642106.178743:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788642106.179316:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788642106.179636:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788642106.179927:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788642106.180088:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788642106.180497:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788642106.180641:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788642106.180894:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788642106.181094:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788642106.181569:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788642106.181724:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788642106.181891:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788642106.182026:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788642106.182224:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788642106.182380:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788642106.182533:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788642106.182666:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788642106.182828:0:5841:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788642106.183008:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788642106.201429:0:5895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788642106.251477:0:5841:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788642106.251520:0:5841:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3a44174f988 00100000:10000000:0.0:1788642106.251529:0:5841:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788642106.252496:0:5841:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788642106.252512:0:5841:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.149@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788642106.252531:0:5841:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788642106.252548:0:5841:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788642106.301894:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788642106.302848:0:5895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788642106.302927:0:5895:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788642106.302932:0:5895:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788642107.326277:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642108.351419:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642109.377744:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642110.394690:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788642111.098819:0:6137:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788642111.165393:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050bd07ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107349632:0@lo:400: 00000100:00100000:3.0:1788642111.165483:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788642111.166615:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788642111.166623:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788642111.166626:0:8:0:(import.c:65:import_set_state_nolock()) 000000001a2b0fd7 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788642111.166638:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001a2b0fd7 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:0.0:1788642111.166674:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d9d07a83 x1875527107349760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788642111.166720:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d9d07a83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875527107349760:0@lo:38: 00000100:00100000:0.0:1788642111.166773:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642111.166841:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107349760 00000100:00100000:0.0:1788642111.166852:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107349760 00000100:00100000:0.0:1788642111.166891:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788642111.166898:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002be3ddc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1875527107349760:12345-0@lo:38: 00010000:00080000:0.0:1788642111.166923:0:5863:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1788642111.166969:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4ae1ee156666cf29 00000004:00100000:0.0:1788642111.167018:0:5863:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788642111.167196:0:5863:0:(import.c:65:import_set_state_nolock()) 00000000c5a0e34d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788642111.167247:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002be3ddc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875527107349760:12345-0@lo:38: Request processed in 348us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642111.167254:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788642111.167294:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d9d07a83 x1875527107349760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788642121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788642111.167307:0:3316:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788642111.167315:0:3316:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788642111.167319:0:3316:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788642111.167320:0:3316:0:(import.c:65:import_set_state_nolock()) 000000001a2b0fd7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788642111.167325:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d9d07a83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875527107349760:0@lo:38: 00000100:00100000:3.0:1788642111.168239:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107349632 00000100:00100000:3.0:1788642111.168248:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107349632 00000100:00100000:3.0:1788642111.169564:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788642111.169586:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e74cf134 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:3319:x1875527107349632:12345-0@lo:400: 00000100:00100000:3.0:1788642111.169688:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e74cf134 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:3319:x1875527107349632:12345-0@lo:400: Request processed in 113us (4205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642111.169695:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788642111.170397:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050bd07ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107349632:0@lo:400: 00010000:00010000:2.0:1788642111.424366:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642112.446450:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642113.466415:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642114.492497:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788642115.259614:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788642115.259623:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dddc599b800 from 3 10000000:01000000:0.0:1788642115.259628:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788642115.259678:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 00000000fd9aab80/0x4ae1ee156666cf30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642115.259689:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 00000000fd9aab80/0x4ae1ee156666cf30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642115.259699:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 00000000fd9aab80/0x4ae1ee156666cf30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642115.259722:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050bd07ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107349888:0@lo:101: 00000100:00100000:0.0:1788642115.259841:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642115.259906:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 000000004bd4cf82 going to sleep for 11 seconds 00000100:00100000:2.0:1788642115.260041:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107349888 00000100:00100000:2.0:1788642115.260054:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107349888 00000100:00100000:2.0:1788642115.260176:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788642115.260184:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:5858:x1875527107349888:12345-0@lo:101: 00010000:00010000:2.0:1788642115.260196:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642115.260207:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad080e69/0x4ae1ee156666cf37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666cf30 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642115.260228:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad080e69/0x4ae1ee156666cf37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666cf30 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642115.260238:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad080e69/0x4ae1ee156666cf37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cf30 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642115.260246:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad080e69, rc 0) 00000100:00100000:2.0:1788642115.260286:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5858:x1875527107349888:12345-0@lo:101: Request processed in 103us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642115.260292:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788642115.260374:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050bd07ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107349888:0@lo:101: 00010000:00010000:0.0:1788642115.260387:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 00000000fd9aab80/0x4ae1ee156666cf30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf37 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642115.260396:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 00000000fd9aab80/0x4ae1ee156666cf30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666cf37 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642115.260443:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050bd07ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107350016:0@lo:256: 00000100:00100000:0.0:1788642115.260470:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642115.263149:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 000000004bd4cf82 going to sleep for 11 seconds 00000100:00100000:1.0:1788642115.263796:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107350016 00000100:00100000:1.0:1788642115.263807:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107350016 00000100:00100000:1.0:1788642115.263857:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788642115.263864:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c990e7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5858:x1875527107350016:12345-0@lo:256: 20000000:01000000:1.0:1788642115.263887:0:5856:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788642115.263908:0:5856:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788642115.263911:0:5856:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788642115.264018:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c990e7c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5858:x1875527107350016:12345-0@lo:256: Request processed in 154us (3547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642115.264025:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788642115.267192:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050bd07ba pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107350016:0@lo:256: 10000000:01000000:0.0:1788642115.267435:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788642115.267445:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: 00000000fd9aab80/0x4ae1ee156666cf30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf37 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642115.267457:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: 00000000fd9aab80/0x4ae1ee156666cf30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf37 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642115.515588:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788642116.153829:0:6339:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb9521d70 20000000:00000080:0.0:1788642116.153857:0:6339:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dddef189000 uarg=0000000000000000 20000000:01000000:0.0:1788642116.154007:0:6339:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788642116.154017:0:6339:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788642116.154024:0:6339:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788642116.154524:0:6339:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788642116.154537:0:6339:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788642116.165442:0:6339:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788642116.165891:0:6339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788642116.166055:0:6339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788642116.166494:0:6339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788642116.166518:0:6339:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788642116.166540:0:6339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642116.166564:0:6339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000071762ee6/0x4ae1ee156666ceff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cef8 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642116.166574:0:6339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642116.166620:0:6339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000071762ee6/0x4ae1ee156666ceff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666cef8 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642116.166637:0:6339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000071762ee6/0x4ae1ee156666ceff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666cef8 expref: 11 pid: 5854 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642116.166654:0:6339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050bd07ba pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6339:1875527107350144:0@lo:104: 00000100:00100000:0.0:1788642116.166739:0:6339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642116.166806:0:6339:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e2046bc going to sleep for 11 seconds 00000100:00100000:3.0:1788642116.166879:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107350144 00000100:00100000:3.0:1788642116.166888:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107350144 00000100:00100000:3.0:1788642116.166952:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788642116.166961:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9d07a83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:6339:x1875527107350144:12345-0@lo:104: 00010000:00010000:3.0:1788642116.166976:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666ceff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167046:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788642116.167051:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9d07a83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:6339:x1875527107350144:12345-0@lo:104: Request processed in 92us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642116.167058:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788642116.167091:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642116.167118:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666ceff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167141:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f06a5f6e already unused, calling callback (000000005615ff68) 10000000:00010000:3.0:1788642116.167144:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666ceff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167152:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666ceff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788642116.167158:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666ceff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642116.167164:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788642116.167192:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666ceff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167198:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642116.167218:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666ceff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167223:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cef8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666ceff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167248:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642116.167249:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642116.167251:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642116.167270:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000939c71fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107350272:0@lo:103: 00000100:00100000:3.0:1788642116.167300:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642116.167342:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107350272 00000100:00100000:3.0:1788642116.167345:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107350272 00010000:00010000:3.0:1788642116.167362:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000071762ee6/0x4ae1ee156666ceff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cef8 expref: 12 pid: 5854 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642116.167393:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788642116.167399:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045f7c296 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:3320:x1875527107350272:12345-0@lo:103: 00010000:00010000:3.0:1788642116.167411:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642116.167416:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000071762ee6/0x4ae1ee156666ceff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cef8 expref: 12 pid: 5854 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167427:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000071762ee6/0x4ae1ee156666ceff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666cef8 expref: 12 pid: 5854 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167445:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167464:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167481:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167488:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167494:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167500:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167505:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003a500520 already unused, calling callback (00000000f101c8ce) 00010000:00010000:3.0:1788642116.167509:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167521:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167529:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642116.167538:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642116.167564:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045f7c296 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:3320:x1875527107350272:12345-0@lo:103: Request processed in 166us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642116.167570:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788642116.167613:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000939c71fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107350272:0@lo:103: 00010000:00010000:2.0:1788642116.167803:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000071762ee6/0x4ae1ee156666ceff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666cef8 expref: 11 pid: 5854 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642116.167815:0:6339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050bd07ba pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6339:1875527107350144:0@lo:104: 00010000:00010000:2.0:1788642116.167828:0:6339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642116.167836:0:6339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642116.167842:0:6339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642116.167858:0:6339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003a500520/0x4ae1ee156666cf3e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642116.283179:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788642116.283216:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d0f3fcea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107350400:0@lo:400: 00000100:00100000:0.0:1788642116.283378:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642116.285735:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107350400 00000100:00100000:2.0:1788642116.285748:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107350400 00000100:00100000:2.0:1788642116.285809:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788642116.285818:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002388e986 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107350400:12345-0@lo:400: 00000100:00100000:2.0:1788642116.285915:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002388e986 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107350400:12345-0@lo:400: Request processed in 98us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642116.285923:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788642116.285949:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d0f3fcea x1875527107350400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642116.285964:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d0f3fcea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107350400:0@lo:400: 00010000:00010000:3.0:1788642116.540698:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642117.566523:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642118.592194:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642119.610397:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642120.642337:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642121.405010:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a3393885 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107350528:0@lo:400: 00000100:00100000:0.0:1788642121.405155:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642121.405294:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107350528 00000100:00100000:2.0:1788642121.405303:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107350528 00000100:00100000:2.0:1788642121.405358:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788642121.405365:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f62478d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:3318:x1875527107350528:12345-0@lo:400: 00000100:00100000:2.0:1788642121.405417:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f62478d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:3318:x1875527107350528:12345-0@lo:400: Request processed in 53us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642121.405424:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788642121.405477:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a3393885 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107350528:0@lo:400: 00000100:00100000:1.0:1788642121.405621:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788642121.405631:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000539f6bbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107350656:0@lo:400: 00000100:00100000:1.0:1788642121.405666:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642121.405709:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107350656 00000100:00100000:1.0:1788642121.405713:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107350656 00000100:00100000:1.0:1788642121.405983:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788642121.405990:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e6025b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107350656:12345-0@lo:400: 00000100:00100000:1.0:1788642121.406027:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e6025b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107350656:12345-0@lo:400: Request processed in 39us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642121.406033:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788642121.406061:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000539f6bbb x1875527107350656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642121.406073:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000539f6bbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107350656:0@lo:400: 00010000:00010000:0.0:1788642121.658238:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642122.682251:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788642122.757509:0:6707:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788642122.757513:0:6707:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788642122.757767:0:6707:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000aaaa95b8 00000020:01000004:3.0:1788642122.757784:0:6707:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788642122.757795:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788642122.757808:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000517ac21b) 00000020:00000080:3.0:1788642122.757823:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788642122.782072:0:6707:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788642122.782830:0:6707:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788642122.819778:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788642122.840705:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788642122.840742:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788642122.840812:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788642122.840843:0:6707:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788642122.842464:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788642122.842478:0:6707:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788642122.842490:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4ae1ee156666cf4c 00000020:01000004:2.0:1788642122.842511:0:6707:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788642122.842534:0:6707:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.149@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788642122.842538:0:6707:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788642122.842544:0:6707:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788642122.842548:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788642122.842561:0:6707:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000e9ca2124) 00000020:00000080:2.0:1788642122.842574:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788642122.846912:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788642122.847162:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788642122.847169:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788642122.854169:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788642122.854184:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788642122.855454:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788642122.855464:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788642122.858904:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788642122.859162:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788642122.859168:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788642122.860828:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788642122.860839:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788642122.900779:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788642122.901162:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788642122.901171:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788642122.902770:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788642122.902784:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788642122.905283:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788642122.905609:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788642122.913444:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788642122.913655:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788642122.913662:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788642122.916574:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788642122.916587:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 10000000:01000000:3.0:1788642122.938170:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788642122.938179:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddc599b800 from 1 10000000:01000000:3.0:1788642122.938183:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788642122.938240:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cf5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642122.938270:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cf5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642122.938282:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cf5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642122.938306:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000939c71fe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107350784:0@lo:101: 00000100:00100000:3.0:1788642122.938400:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642122.938455:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 000000002111212c going to sleep for 11 seconds 00000100:00100000:1.0:1788642122.939216:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107350784 00000100:00100000:1.0:1788642122.939227:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107350784 00000100:00100000:1.0:1788642122.939336:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788642122.939345:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000698ddba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:5858:x1875527107350784:12345-0@lo:101: 00010000:00010000:1.0:1788642122.939362:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642122.939380:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da8610e5/0x4ae1ee156666cf61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666cf5a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642122.939431:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da8610e5/0x4ae1ee156666cf61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666cf5a expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642122.939443:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da8610e5/0x4ae1ee156666cf61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cf5a expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642122.939454:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da8610e5, rc 0) 00000100:00100000:1.0:1788642122.939523:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000698ddba4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5858:x1875527107350784:12345-0@lo:101: Request processed in 180us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642122.939530:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788642122.939635:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000939c71fe pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107350784:0@lo:101: 00010000:00010000:0.0:1788642122.939653:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cf5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642122.939663:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: 00000000f06a5f6e/0x4ae1ee156666cf5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666cf61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642122.939729:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f8bc254 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107350912:0@lo:501: 00000100:00100000:0.0:1788642122.939761:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642122.946453:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 0000000038465490 going to sleep for 11 seconds 00000100:00100000:3.0:1788642122.947720:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107350912 00000100:00100000:3.0:1788642122.947736:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107350912 00000100:00100000:3.0:1788642122.947798:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788642122.947807:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000891c4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5858:x1875527107350912:12345-0@lo:501: 00000100:00100000:3.0:1788642122.948238:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000891c4f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5858:x1875527107350912:12345-0@lo:501: Request processed in 432us (8474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642122.948246:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788642122.950077:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f8bc254 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107350912:0@lo:501: 00000100:00100000:3.0:1788642122.950154:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004bd0a154 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107351040:0@lo:503: 00000100:00100000:3.0:1788642122.950226:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642122.950272:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bac8c280 going to sleep for 11 seconds 00000100:00100000:3.0:1788642122.950293:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107351040 00000100:00100000:3.0:1788642122.950300:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107351040 00000100:00100000:3.0:1788642122.950336:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788642122.950342:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e0bb360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5858:x1875527107351040:12345-0@lo:503: 00000100:00100000:3.0:1788642122.950687:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e0bb360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5858:x1875527107351040:12345-0@lo:503: Request processed in 345us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642122.950703:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788642122.950762:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004bd0a154 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107351040:0@lo:503: 00000100:00100000:1.0:1788642122.954457:0:6720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000539f6bbb pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:6720:1875527107351168:0@lo:502: 00000100:00100000:1.0:1788642122.954538:0:6720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642122.954596:0:6720:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf489c3f going to sleep for 11 seconds 00000100:00100000:3.0:1788642122.954716:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107351168 00000100:00100000:3.0:1788642122.954725:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107351168 00000100:00100000:3.0:1788642122.954776:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788642122.954785:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad346346 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6720:x1875527107351168:12345-0@lo:502: 00000100:00100000:3.0:1788642122.955066:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad346346 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6720:x1875527107351168:12345-0@lo:502: Request processed in 282us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642122.955075:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788642122.955198:0:6720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000539f6bbb pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:6720:1875527107351168:0@lo:502: 00000020:01000000:1.0:1788642122.955229:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788642122.955238:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642122.955240:0:6720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788642122.955248:0:6720:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dddc599b800 00000020:00000080:1.0:1788642122.955251:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788642122.955293:0:6720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:6720:1875527107351296:0@lo:502: 00000100:00100000:1.0:1788642122.955328:0:6720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642122.955357:0:6720:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc734d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642122.955719:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107351296 00000100:00100000:3.0:1788642122.955725:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107351296 00000100:00100000:3.0:1788642122.955762:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788642122.955770:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6720:x1875527107351296:12345-0@lo:502: 00000100:00100000:3.0:1788642122.955921:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6720:x1875527107351296:12345-0@lo:502: Request processed in 151us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642122.955929:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788642122.956141:0:6720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:6720:1875527107351296:0@lo:502: 00000020:01000000:1.0:1788642122.956165:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642122.956170:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642122.956172:0:6720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788642122.956176:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788642122.956486:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788642122.956509:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788642122.956519:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666cf5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642122.956530:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666cf5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642122.982501:0:6707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788642122.982797:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788642122.982803:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788642122.986199:0:6707:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788642122.986217:0:6707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788642122.987859:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788642122.987902:0:6707:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788642122.987909:0:6707:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.149@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788642123.023086:0:6707:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788642123.023167:0:6707:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.149@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788642123.023176:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788642123.023178:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788642123.023180:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788642123.023181:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788642123.023183:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788642123.023184:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788642123.023185:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788642123.023187:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788642123.023188:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788642123.023190:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788642123.023191:0:6707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788642123.023197:0:6707:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788642123.023200:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788642123.023201:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788642123.023203:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788642123.023204:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788642123.023205:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788642123.023206:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788642123.023211:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788642123.023212:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788642123.023213:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788642123.023214:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788642123.023215:0:6707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788642123.023432:0:6707:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788642123.023449:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107351424:0@lo:253: 00000100:00100000:2.0:1788642123.023549:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642123.023711:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd13dfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788642123.025504:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107351424 00000100:00100000:3.0:1788642123.025517:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107351424 00000100:00100000:2.0:1788642123.027470:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788642123.027483:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107351424:12345-0@lo:253: 20000000:01000000:2.0:1788642123.027519:0:5854:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788642123.027523:0:5854:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788642123.027529:0:5854:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788642123.027533:0:5854:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788642123.028455:0:5854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788642123.028665:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788642123.028680:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788642123.028719:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788642123.028727:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788642123.028760:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788642123.028813:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788642123.029217:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788642123.029238:0:5854:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.149@tcp 20000000:01000000:2.0:1788642123.029240:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.149@tcp (null) (null) (null) 00000040:00080000:2.0:1788642123.029278:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788642123.029286:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788642123.029337:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788642123.029345:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.149@tcp (null) (null) 00000040:00080000:2.0:1788642123.029380:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788642123.029390:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788642123.029425:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788642123.029501:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788642123.030254:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788642123.030273:0:5854:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.149@tcp 20000000:01000000:2.0:1788642123.030275:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.149@tcp (null) (null) (null) 00000040:00080000:2.0:1788642123.030308:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788642123.030316:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788642123.030348:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788642123.030355:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.149@tcp (null) (null) 00000040:00080000:2.0:1788642123.030414:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788642123.030425:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788642123.030461:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788642123.030511:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788642123.030528:0:5854:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788642123.030532:0:5854:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788642123.030538:0:5854:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788642123.030540:0:5854:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788642123.030543:0:5854:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788642123.030555:0:5854:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788642123.030557:0:5854:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788642123.030589:0:5854:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788642123.030592:0:5854:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788642123.039599:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788642123.040017:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788642123.040068:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788642123.040194:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788642123.040212:0:5854:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788642123.040215:0:5854:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788642123.043821:0:6724:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788642123.043911:0:6724:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788642123.043967:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788642123.044414:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788642123.044486:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788642123.044523:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788642123.044539:0:5854:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788642123.044541:0:5854:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788642123.045258:0:6725:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788642123.045311:0:6725:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788642123.045372:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788642123.045599:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788642123.045721:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788642123.045778:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:0.0:1788642123.045798:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788642123.045818:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.045838:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666ce81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666ce7a expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.045859:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666ce9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666ce96 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.045866:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc9832800/0x4ae1ee156666cf0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cf06 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.045874:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.045912:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc9832800/0x4ae1ee156666cf0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666cf06 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.045927:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddc9832800/0x4ae1ee156666cf0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666cf06 expref: 12 pid: 5853 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642123.045942:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107351552:0@lo:104: 00000100:00100000:0.0:1788642123.046023:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788642123.046093:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666ce9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666ce96 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642123.046248:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107351552 00000100:00100000:1.0:1788642123.046257:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107351552 00000100:00100000:1.0:1788642123.046313:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788642123.046322:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5854:x1875527107351552:12345-0@lo:104: 00010000:00010000:1.0:1788642123.046337:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666cf06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cf0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.046393:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788642123.046399:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5854:x1875527107351552:12345-0@lo:104: Request processed in 79us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642123.046405:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788642123.046458:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788642123.046466:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666cf06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cf0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642123.046473:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121400 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:2.0:1788642123.046476:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666cf06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666cf0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642123.046486:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666cf06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666cf0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788642123.046506:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666cf06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666cf0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788642123.046512:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788642123.046544:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666cf06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cf0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642123.046551:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788642123.046580:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666cf06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cf0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642123.046588:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666cf06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cf0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642123.046599:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642123.046601:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642123.046603:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642123.046743:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666ce9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666ce96 expref: 12 pid: 5856 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642123.046755:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107351680:0@lo:104: 00000100:00100000:0.0:1788642123.046785:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788642123.046828:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666ce81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666ce7a expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.046836:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666ce81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666ce7a expref: 12 pid: 5854 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642123.046852:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107351936:0@lo:104: 00000100:00100000:0.0:1788642123.046874:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642123.046885:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788642123.046906:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107351552:0@lo:104: 00000100:00100000:0.0:1788642123.046920:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642123.046932:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107351808:0@lo:103: 00000100:00100000:0.0:1788642123.046957:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642123.046999:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107351808 00000100:00100000:0.0:1788642123.047004:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107351808 00010000:00010000:0.0:1788642123.047025:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc9832800/0x4ae1ee156666cf0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cf06 expref: 13 pid: 5853 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642123.047047:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642123.047054:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:3319:x1875527107351808:12345-0@lo:103: 00010000:00010000:0.0:1788642123.047064:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642123.047069:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc9832800/0x4ae1ee156666cf0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cf06 expref: 13 pid: 5853 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.047079:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc9832800/0x4ae1ee156666cf0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666cf06 expref: 13 pid: 5853 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.047091:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9832800/0x4ae1ee156666cf0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666cf06 expref: 13 pid: 5853 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.047123:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642123.047152:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:3319:x1875527107351808:12345-0@lo:103: Request processed in 98us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642123.047158:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642123.047195:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107351808:0@lo:103: 00000100:00100000:3.0:1788642123.047332:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107351680 00000100:00100000:3.0:1788642123.047337:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107351680 00000100:00100000:3.0:1788642123.047358:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107351936 00000100:00100000:3.0:1788642123.047360:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107351936 00000100:00100000:3.0:1788642123.047373:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788642123.047379:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:5854:x1875527107351680:12345-0@lo:104: 00010000:00010000:3.0:1788642123.047390:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666ce96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666ce9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642123.047554:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107351680:0@lo:104: 00010000:00010000:3.0:1788642123.047599:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788642123.047606:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:5854:x1875527107351680:12345-0@lo:104: Request processed in 227us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.047622:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788642123.047639:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788642123.047654:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5854:x1875527107351936:12345-0@lo:104: 00010000:00010000:3.0:1788642123.047663:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666ce7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642123.047738:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107351936:0@lo:104: 00010000:00010000:0.0:1788642123.047757:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048023:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788642123.048030:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666ce96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666ce9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048043:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9c00 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:1.0:1788642123.048048:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666ce96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666ce9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048056:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666ce96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666ce9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788642123.048063:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666ce96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666ce9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642123.048068:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788642123.048132:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666ce96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666ce9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048139:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788642123.048160:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666ce96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666ce9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048168:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666ce96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666ce9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048179:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642123.048182:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666ce7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048188:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50a00 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:1.0:1788642123.048190:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666ce7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048208:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666ce7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788642123.048215:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666ce7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642123.048220:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788642123.048233:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666ce7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048239:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788642123.048244:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666ce7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048250:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666ce7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666ce81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048270:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642123.048271:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642123.048273:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642123.048285:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107352192:0@lo:103: 00000100:00100000:1.0:1788642123.048318:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642123.048351:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788642123.048358:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107352064:0@lo:103: 00000100:00100000:1.0:1788642123.048394:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642123.048423:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107352192 00000100:00100000:1.0:1788642123.048427:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107352192 00010000:00010000:1.0:1788642123.048445:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666ce81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666ce7a expref: 12 pid: 5854 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642123.048474:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107352064 00000100:00100000:1.0:1788642123.048478:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107352064 00010000:00010000:1.0:1788642123.048490:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666ce9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666ce96 expref: 13 pid: 5856 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642123.048502:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788642123.048509:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:3318:x1875527107352192:12345-0@lo:103: 00010000:00010000:1.0:1788642123.048520:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642123.048525:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666ce81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666ce7a expref: 13 pid: 5854 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048534:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666ce81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666ce7a expref: 13 pid: 5854 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048547:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666ce81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666ce7a expref: 13 pid: 5854 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048561:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642123.048589:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:3318:x1875527107352192:12345-0@lo:103: Request processed in 81us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642123.048595:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788642123.048858:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788642123.048867:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:3318:x1875527107352064:12345-0@lo:103: 00010000:00010000:1.0:1788642123.048875:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642123.048881:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666ce9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666ce96 expref: 11 pid: 5856 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048890:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666ce9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666ce96 expref: 11 pid: 5856 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048908:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666ce9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666ce96 expref: 11 pid: 5856 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048919:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048927:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048940:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048948:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048954:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048960:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048966:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833a00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642123.048970:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.048977:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.049008:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.049027:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642123.049051:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef153480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+10:3318:x1875527107352064:12345-0@lo:103: Request processed in 185us (656us total) trans 0 rc 0/0 00010000:00010000:2.0:1788642123.049087:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642123.049095:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642123.049118:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666cf68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788642123.049131:0:5854:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1788642123.049547:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788642123.049556:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5854:x1875527107351936:12345-0@lo:104: Request processed in 1902us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.049564:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788642123.049626:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642123.049935:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788642123.051159:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107352064:0@lo:103: 00000100:00100000:1.0:1788642123.051170:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107352192:0@lo:103: 00000100:00100000:0.0:1788642123.097619:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+9:6707:x1875527107351424:12345-0@lo:253: Request processed in 70121us (74053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642123.097635:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788642123.097797:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107351424:0@lo:253: 10000000:01000000:3.0:1788642123.097814:0:6707:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788642123.097818:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788642123.097819:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788642123.097821:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642123.097822:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788642123.097824:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642123.097825:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642123.097827:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788642123.097828:0:6707:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788642123.097830:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642123.097832:0:6707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788642123.097890:0:6707:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dddef9be800 from lustre-OST0000 10000000:01000000:3.0:1788642123.097918:0:6707:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788642123.097921:0:6707:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788642123.097928:0:6707:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dddc4e04d40 local copy 10000000:01000000:3.0:1788642123.097933:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788642123.097972:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.097994:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.098004:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642123.098041:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107352320:0@lo:101: 00000100:00100000:3.0:1788642123.098078:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642123.098159:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5f88300 going to sleep for 11 seconds 00000100:00100000:1.0:1788642123.098883:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107352320 00000100:00100000:1.0:1788642123.098894:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107352320 00000100:00100000:1.0:1788642123.098944:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788642123.098954:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+9:6707:x1875527107352320:12345-0@lo:101: 00010000:00010000:1.0:1788642123.098967:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642123.098997:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666cf76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666cf6f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.099020:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666cf76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666cf6f expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.099031:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666cf76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cf6f expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.099039:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50a00, rc 0) 00000100:00100000:1.0:1788642123.099121:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+10:6707:x1875527107352320:12345-0@lo:101: Request processed in 146us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642123.099128:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788642123.099270:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107352320:0@lo:101: 00010000:00010000:3.0:1788642123.099285:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4ae1ee156666cf76 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.099294:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4ae1ee156666cf76 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642123.099437:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107352448:0@lo:501: 00000100:00100000:3.0:1788642123.099469:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642123.099506:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5f88300 going to sleep for 11 seconds 00000100:00100000:0.0:1788642123.099565:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107352448 00000100:00100000:0.0:1788642123.099569:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107352448 00000100:00100000:0.0:1788642123.099617:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788642123.099624:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+10:6707:x1875527107352448:12345-0@lo:501: 00000100:00100000:0.0:1788642123.099854:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+10:6707:x1875527107352448:12345-0@lo:501: Request processed in 230us (384us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788642123.099861:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788642123.100046:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107352448:0@lo:501: 10000000:01000000:3.0:1788642123.100058:0:6707:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788642123.100086:0:6707:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788642123.100093:0:6707:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4ae1ee156666cf76 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.100132:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4ae1ee156666cf76 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.100140:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4ae1ee156666cf76 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.100165:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788642123.100197:0:6707:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dddef9be800 10000000:01000000:3.0:1788642123.100201:0:6707:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788642123.100206:0:6707:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8dddc4e04d40 10000000:01000000:3.0:1788642123.100208:0:6707:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788642123.100211:0:6707:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dddc4e04d40 from 1 10000000:01000000:3.0:1788642123.100214:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788642123.100237:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6120c00/0x4ae1ee156666cf7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.100244:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddd6120c00/0x4ae1ee156666cf7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.100254:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddd6120c00/0x4ae1ee156666cf7d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642123.100269:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107352576:0@lo:101: 00000100:00100000:3.0:1788642123.100298:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642123.100316:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd13dfd80 going to sleep for 11 seconds 00010000:00010000:1.0:1788642123.100373:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642123.100381:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4ae1ee156666cf76 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.100395:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121a00 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:1.0:1788642123.100398:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4ae1ee156666cf76 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.100407:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x4ae1ee156666cf76 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788642123.100415:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x4ae1ee156666cf76 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642123.100421:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788642123.100439:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4ae1ee156666cf76 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.100445:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788642123.100476:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4ae1ee156666cf76 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.100484:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cf6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4ae1ee156666cf76 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.100589:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642123.100592:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642123.100593:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642123.100602:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788642123.100622:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107352704:0@lo:103: 00000100:00100000:1.0:1788642123.100649:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642123.100797:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107352576 00000100:00100000:0.0:1788642123.100803:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107352576 00000100:00100000:0.0:1788642123.100838:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788642123.100845:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+10:6707:x1875527107352576:12345-0@lo:101: 00010000:00010000:0.0:1788642123.100854:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642123.100867:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9832800/0x4ae1ee156666cf84 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666cf7d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.100890:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9832800/0x4ae1ee156666cf84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666cf7d expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.100902:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9832800/0x4ae1ee156666cf84 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cf7d expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.100919:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9832800, rc 0) 00000100:00100000:0.0:1788642123.100963:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:6707:x1875527107352576:12345-0@lo:101: Request processed in 119us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642123.100969:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788642123.101009:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107352704 00000100:00100000:0.0:1788642123.101013:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107352704 00000100:00100000:0.0:1788642123.101043:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788642123.101049:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:3320:x1875527107352704:12345-0@lo:103: 00010000:00010000:0.0:1788642123.101057:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642123.101069:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666cf76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666cf6f expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.101086:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642123.101185:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107352576:0@lo:101: 00010000:00010000:3.0:1788642123.101202:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddd6120c00/0x4ae1ee156666cf7d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf84 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.101209:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddd6120c00/0x4ae1ee156666cf7d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666cf84 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642123.101406:0:6707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788642123.101459:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6120c00/0x4ae1ee156666cf7d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf84 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.101467:0:6707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddd6120c00/0x4ae1ee156666cf7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf84 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642123.101482:0:6707:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788642123.101486:0:6707:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788642123.101491:0:6707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788642123.101493:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788642123.101510:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.101518:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.101525:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642123.101538:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107352832:0@lo:101: 00000100:00100000:3.0:1788642123.101566:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642123.101595:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd13dfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788642123.101652:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107352832 00000100:00100000:1.0:1788642123.101656:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107352832 00000100:00100000:1.0:1788642123.101697:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788642123.101703:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:6707:x1875527107352832:12345-0@lo:101: 00010000:00010000:1.0:1788642123.101709:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642123.101718:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddcfb51800/0x4ae1ee156666cf92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666cf8b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.101732:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddcfb51800/0x4ae1ee156666cf92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666cf8b expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.101740:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddcfb51800/0x4ae1ee156666cf92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cf8b expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642123.101747:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51800, rc 0) 00000100:00100000:1.0:1788642123.101774:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107352832:12345-0@lo:101: Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642123.101780:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788642123.101893:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:3320:x1875527107352704:12345-0@lo:103: Request processed in 844us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642123.101900:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788642123.101960:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107352704:0@lo:103: 00000100:00100000:3.0:1788642123.102030:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107352832:0@lo:101: 00010000:00010000:3.0:1788642123.102042:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf92 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.102050:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666cf92 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642123.102157:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107352960:0@lo:501: 00000100:00100000:3.0:1788642123.102185:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642123.102200:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd13dfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788642123.102256:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107352960 00000100:00100000:1.0:1788642123.102261:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107352960 00000100:00100000:1.0:1788642123.102292:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788642123.102298:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:6707:x1875527107352960:12345-0@lo:501: 00000100:00100000:1.0:1788642123.102516:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:6707:x1875527107352960:12345-0@lo:501: Request processed in 218us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642123.102524:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788642123.102773:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107352960:0@lo:501: 00000100:00100000:0.0:1788642123.102805:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353088:0@lo:503: 00000100:00100000:0.0:1788642123.102841:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642123.102861:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642123.102909:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107353088 00000100:00100000:3.0:1788642123.102918:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107353088 00000100:00100000:3.0:1788642123.102949:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788642123.102955:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:6707:x1875527107353088:12345-0@lo:503: 00000100:00100000:3.0:1788642123.103131:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:6707:x1875527107353088:12345-0@lo:503: Request processed in 175us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.103138:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788642123.103273:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353088:0@lo:503: 00000040:00080000:0.0:1788642123.103568:0:6707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788642123.103642:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353216:0@lo:502: 00000100:00100000:0.0:1788642123.103673:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642123.103691:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642123.104138:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107353216 00000100:00100000:3.0:1788642123.104145:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107353216 00000100:00100000:3.0:1788642123.104182:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788642123.104191:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:6707:x1875527107353216:12345-0@lo:502: 00000100:00100000:3.0:1788642123.104372:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:6707:x1875527107353216:12345-0@lo:502: Request processed in 181us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.104378:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788642123.104487:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353216:0@lo:502: 00000040:00080000:1.0:1788642123.104766:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788642123.104819:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788642123.104855:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788642123.104916:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788642123.104953:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788642123.104997:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788642123.105030:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353344:0@lo:502: 00000100:00100000:1.0:1788642123.105074:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642123.105124:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc734d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642123.105315:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107353344 00000100:00100000:0.0:1788642123.105321:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107353344 00000100:00100000:0.0:1788642123.105361:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788642123.105368:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:6707:x1875527107353344:12345-0@lo:502: 00000100:00100000:0.0:1788642123.105511:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:6707:x1875527107353344:12345-0@lo:502: Request processed in 142us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642123.105517:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788642123.105683:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353344:0@lo:502: 00000040:00080000:1.0:1788642123.105763:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788642123.105773:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788642123.106260:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788642123.106268:0:6727:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788642123.106274:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642123.106276:0:6727:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788642123.106281:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788642123.106296:0:6727:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8dddc63419c0) 00000020:00000080:1.0:1788642123.106318:0:6727:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788642123.106323:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788642123.106396:0:6727:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dddef9be800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788642123.106403:0:6727:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788642123.106410:0:6727:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4ae1ee156666cfa0 00010000:00010000:0.0:1788642123.113475:0:6727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788642123.113911:0:6727:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788642123.116969:0:6727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788642123.117430:0:6727:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788642123.122945:0:6727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788642123.123729:0:6727:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788642123.125131:0:6727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788642123.125143:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642123.125151:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642123.125154:0:6727:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788642123.125157:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642123.125161:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642123.125163:0:6727:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788642123.125166:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788642123.125168:0:6727:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788642123.125216:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642123.125220:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642123.125221:0:6727:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788642123.125224:0:6727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788642123.125282:0:6707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788642123.125304:0:6707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788642123.125322:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf92 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.125345:0:6707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cf92 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642123.125353:0:6707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddef9be800 from 1 10000000:01000000:0.0:1788642123.125356:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788642123.125392:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.125400:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.125411:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642123.125436:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353472:0@lo:101: 00000100:00100000:0.0:1788642123.125505:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642123.125565:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e729c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642123.125590:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107353472 00000100:00100000:0.0:1788642123.125598:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107353472 00000100:00100000:0.0:1788642123.128127:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788642123.128142:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:6707:x1875527107353472:12345-0@lo:101: 00010000:00010000:0.0:1788642123.128160:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642123.128181:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666cfae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666cfa7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.128215:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666cfae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666cfa7 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.128228:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666cfae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cfa7 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.128246:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833400, rc 0) 00000100:00100000:0.0:1788642123.128327:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107353472:12345-0@lo:101: Request processed in 188us (2822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642123.128335:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788642123.128481:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353472:0@lo:101: 00010000:00010000:0.0:1788642123.128503:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cfae expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.128514:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666cfae expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642123.128640:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353600:0@lo:501: 00000100:00100000:0.0:1788642123.128676:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642123.128708:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642123.130157:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107353600 00000100:00100000:3.0:1788642123.130173:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107353600 00000100:00100000:3.0:1788642123.130237:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788642123.130247:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107353600:12345-0@lo:501: 00000100:00100000:3.0:1788642123.130536:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107353600:12345-0@lo:501: Request processed in 290us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.130544:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788642123.130831:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353600:0@lo:501: 00000100:00100000:0.0:1788642123.130880:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353728:0@lo:503: 00000100:00100000:0.0:1788642123.130928:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642123.130957:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642123.131176:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107353728 00000100:00100000:3.0:1788642123.131182:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107353728 00000100:00100000:3.0:1788642123.131214:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788642123.131221:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107353728:12345-0@lo:503: 00000100:00100000:3.0:1788642123.131379:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107353728:12345-0@lo:503: Request processed in 158us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.131387:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788642123.131513:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353728:0@lo:503: 00000040:00080000:0.0:1788642123.131818:0:6707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788642123.131971:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353856:0@lo:502: 00000100:00100000:0.0:1788642123.132017:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642123.132038:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642123.132122:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107353856 00000100:00100000:3.0:1788642123.132128:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107353856 00000100:00100000:3.0:1788642123.132159:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788642123.132168:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107353856:12345-0@lo:502: 00000100:00100000:3.0:1788642123.132308:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107353856:12345-0@lo:502: Request processed in 143us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.132314:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788642123.132346:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353856:0@lo:502: 00000040:00080000:3.0:1788642123.132532:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788642123.132562:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788642123.132576:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353984:0@lo:502: 00000100:00100000:3.0:1788642123.132600:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642123.132668:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddddc2c6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788642123.132678:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107353984 00000100:00100000:3.0:1788642123.132681:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107353984 00000100:00100000:3.0:1788642123.132693:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788642123.132697:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107353984:12345-0@lo:502: 00000100:00100000:3.0:1788642123.132770:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107353984:12345-0@lo:502: Request processed in 72us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.132774:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788642123.132808:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107353984:0@lo:502: 00000040:00080000:3.0:1788642123.132880:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788642123.132889:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788642123.141245:0:6731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642123.141262:0:6731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642123.141270:0:6731:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788642123.141280:0:6731:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dddef9be800 00000020:00000080:0.0:1788642123.141283:0:6731:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788642123.141309:0:6731:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642123.141313:0:6731:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642123.141314:0:6731:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788642123.141317:0:6731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788642123.144334:0:6707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788642123.144378:0:6707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788642123.144420:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cfae expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642123.144435:0:6707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cfae expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788642123.144495:0:6707:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788642123.144499:0:6707:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dddef9be800 10000000:01000000:2.0:1788642123.144502:0:6707:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dddef9be800 10000000:01000000:2.0:1788642123.144507:0:6707:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788642123.144513:0:6707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dddef9be800 from 1 10000000:01000000:2.0:1788642123.144516:0:6707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788642123.144557:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642123.144566:0:6707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642123.144579:0:6707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642123.144761:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107354112:0@lo:101: 00000100:00100000:2.0:1788642123.144844:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642123.144936:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc995a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642123.145059:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107354112 00000100:00100000:0.0:1788642123.145070:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107354112 00000100:00100000:0.0:1788642123.145353:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788642123.145366:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107354112:12345-0@lo:101: 00010000:00010000:0.0:1788642123.145381:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642123.145396:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666cfbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666cfb5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.145421:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666cfbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666cfb5 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.145434:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666cfbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cfb5 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.145444:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9832000, rc 0) 00000100:00100000:0.0:1788642123.145499:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:6707:x1875527107354112:12345-0@lo:101: Request processed in 137us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642123.145506:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788642123.145583:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107354112:0@lo:101: 00010000:00010000:2.0:1788642123.145602:0:6707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cfbc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642123.145624:0:6707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666cfbc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642123.145781:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107354240:0@lo:501: 00000100:00100000:2.0:1788642123.145810:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642123.146008:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc995a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642123.146093:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107354240 00000100:00100000:3.0:1788642123.146128:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107354240 00000100:00100000:3.0:1788642123.146157:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788642123.146165:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:6707:x1875527107354240:12345-0@lo:501: 00000100:00100000:3.0:1788642123.146475:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:6707:x1875527107354240:12345-0@lo:501: Request processed in 308us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.146483:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788642123.146575:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107354240:0@lo:501: 00000100:00100000:2.0:1788642123.146673:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107354368:0@lo:503: 00000100:00100000:2.0:1788642123.146716:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642123.146741:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc995a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642123.146795:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107354368 00000100:00100000:3.0:1788642123.146800:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107354368 00000100:00100000:3.0:1788642123.146822:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788642123.146827:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:6707:x1875527107354368:12345-0@lo:503: 00000100:00100000:3.0:1788642123.147007:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:6707:x1875527107354368:12345-0@lo:503: Request processed in 178us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.147014:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788642123.147091:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107354368:0@lo:503: 00000040:00080000:2.0:1788642123.147369:0:6707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788642123.147419:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107354496:0@lo:502: 00000100:00100000:2.0:1788642123.147452:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642123.147475:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc995a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642123.147525:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107354496 00000100:00100000:3.0:1788642123.147529:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107354496 00000100:00100000:3.0:1788642123.147546:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788642123.147552:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:6707:x1875527107354496:12345-0@lo:502: 00000100:00100000:3.0:1788642123.147766:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:6707:x1875527107354496:12345-0@lo:502: Request processed in 214us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.147773:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788642123.147897:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107354496:0@lo:502: 00000040:00080000:2.0:1788642123.148166:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788642123.148215:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788642123.148249:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788642123.148298:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788642123.148336:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788642123.148393:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788642123.148429:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788642123.148463:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788642123.148509:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788642123.148546:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788642123.148580:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788642123.148712:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788642123.148752:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788642123.148807:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788642123.148858:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788642123.148896:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788642123.148930:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788642123.148988:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788642123.149027:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788642123.149058:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788642123.149129:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788642123.149165:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788642123.149194:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788642123.149236:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788642123.149272:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788642123.149304:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788642123.149351:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788642123.149385:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788642123.149426:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107354624:0@lo:502: 00000100:00100000:2.0:1788642123.149492:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642123.149527:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc995a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642123.149623:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107354624 00000100:00100000:3.0:1788642123.149630:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107354624 00000100:00100000:3.0:1788642123.149661:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788642123.149668:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:6707:x1875527107354624:12345-0@lo:502: 00000100:00100000:3.0:1788642123.149863:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:6707:x1875527107354624:12345-0@lo:502: Request processed in 194us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.149870:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788642123.152149:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107354624:0@lo:502: 00000040:00080000:2.0:1788642123.152283:0:6707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788642123.152297:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788642123.153479:0:6732:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788642123.153496:0:6732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8dddc6340000) 00000020:00000080:1.0:1788642123.153516:0:6732:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788642123.153689:0:6732:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dddef9be800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788642123.153693:0:6732:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dddef9be800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788642123.153696:0:6732:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dddef9be800 3 00010000:00080000:1.0:1788642123.153726:0:6732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ddcc5338000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.149@tcp at head 00010000:00010000:2.0:1788642123.163982:0:6732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788642123.164265:0:6732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788642123.164306:0:6732:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788642123.164329:0:6732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4ae1ee156666cfca 00000100:00080000:2.0:1788642123.164340:0:6732:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788642123.164346:0:6732:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ddcc5338000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788642123.164381:0:6732:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddef17c700 x1875527107354752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788642123.164403:0:6732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788642123.164516:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107354880:0@lo:400: 00000100:00100000:3.0:1788642123.164594:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642123.164693:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1875527107354752:0@lo:38: 00000100:00100000:0.0:1788642123.164727:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642123.164766:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107354880 00000100:00100000:0.0:1788642123.164774:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107354880 00000100:00100000:0.0:1788642123.164812:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107354752 00000100:00100000:0.0:1788642123.164821:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107354752 00000100:00100000:0.0:1788642123.164838:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642123.164846:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107354880:12345-0@lo:400: 00000100:00100000:0.0:1788642123.164907:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107354880:12345-0@lo:400: Request processed in 61us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642123.164915:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642123.164930:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642123.164934:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3316:x1875527107354752:12345-0@lo:38: 00010000:00080000:0.0:1788642123.164953:0:5862:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1788642123.164994:0:5862:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4ae1ee156666cfd1 00000004:00100000:0.0:1788642123.165010:0:5862:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788642123.165046:0:5862:0:(import.c:65:import_set_state_nolock()) ffff8dddfb4db000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788642123.165092:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875527107354752:12345-0@lo:38: Request processed in 156us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642123.165119:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788642123.165157:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dddef17c700 x1875527107354752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788642133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642123.165167:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788642123.165175:0:3316:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788642123.165182:0:3316:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788642123.165187:0:3316:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788642123.165189:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8ddcc5338000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788642123.165195:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1875527107354752:0@lo:38: 00010000:00080000:3.0:1788642123.165335:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dddc64f0380 x1875527107354880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642123.165345:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107354880:0@lo:400: 00000040:00080000:2.0:1788642123.165539:0:6732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788642123.165910:0:6707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788642123.165939:0:6707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788642123.166002:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cfbc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.166014:0:6707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cfbc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788642123.166077:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788642123.166080:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788642123.166081:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642123.166082:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642123.166083:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642123.166085:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642123.166086:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788642123.166087:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788642123.166089:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788642123.166091:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642123.166092:0:6707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788642123.166121:0:6707:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788642123.166124:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788642123.166125:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788642123.166127:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642123.166128:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642123.166129:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642123.166130:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642123.166131:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788642123.166132:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788642123.166133:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788642123.166134:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642123.166135:0:6707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788642123.166155:0:6707:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788642123.166177:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107355008:0@lo:253: 00000100:00100000:3.0:1788642123.166229:0:6707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642123.166267:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc651f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788642123.166416:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107355008 00000100:00100000:2.0:1788642123.166425:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107355008 00000100:00100000:2.0:1788642123.166470:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788642123.166480:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:6707:x1875527107355008:12345-0@lo:253: 20000000:01000000:2.0:1788642123.166509:0:5853:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788642123.166528:0:5853:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788642123.200560:0:5853:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788642123.200580:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788642123.200691:0:5877:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788642123.200696:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788642123.200718:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.200751:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666cf37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cf30 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.200760:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.200796:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666cf37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666cf30 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642123.200809:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666cf37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666cf30 expref: 13 pid: 5854 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642123.200823:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1875527107355136:0@lo:104: 00000100:00100000:0.0:1788642123.200884:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642123.200947:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642123.201616:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107355136 00000100:00100000:3.0:1788642123.201624:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107355136 00000100:00100000:3.0:1788642123.201677:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788642123.201685:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5877:x1875527107355136:12345-0@lo:104: 00010000:00010000:3.0:1788642123.201699:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666cf30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cf37 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.201763:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788642123.201769:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5877:x1875527107355136:12345-0@lo:104: Request processed in 85us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.201777:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788642123.201813:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1875527107355136:0@lo:104: 00010000:00010000:3.0:1788642123.201832:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.201848:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642123.201854:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666cf30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cf37 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.201861:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9832400 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642123.201865:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666cf30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666cf37 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.201873:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666cf30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666cf37 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788642123.201887:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666cf30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666cf37 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642123.201893:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788642123.201921:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666cf30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cf37 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.201927:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642123.201946:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666cf30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cf37 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.201952:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666cf30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cf37 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.201966:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642123.201977:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642123.201979:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642123.201999:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107355264:0@lo:103: 00000100:00100000:3.0:1788642123.202032:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642123.202078:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107355264 00000100:00100000:3.0:1788642123.202083:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107355264 00010000:00010000:3.0:1788642123.202123:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666cf37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cf30 expref: 14 pid: 5854 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642123.202144:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788642123.202151:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddde4e64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:3317:x1875527107355264:12345-0@lo:103: 00010000:00010000:3.0:1788642123.202160:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642123.202165:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666cf37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cf30 expref: 14 pid: 5854 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202180:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666cf37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666cf30 expref: 14 pid: 5854 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202192:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666cf37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666cf30 expref: 14 pid: 5854 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202203:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202210:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788642123.202223:0:5845:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001527261s 00010000:00010000:3.0:1788642123.202227:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202233:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202239:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202245:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202251:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9832e00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:3.0:1788642123.202255:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202261:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202280:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202289:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642123.202312:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddde4e64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:3317:x1875527107355264:12345-0@lo:103: Request processed in 162us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.202318:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788642123.202359:0:5877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202366:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642123.202372:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666cfd8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642123.202396:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107355264:0@lo:103: 00000100:00100000:3.0:1788642123.211217:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:6707:x1875527107355008:12345-0@lo:253: Request processed in 44729us (44978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642123.211234:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788642123.211317:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:6707:1875527107355008:0@lo:253: 10000000:01000000:2.0:1788642123.211331:0:6707:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788642123.211335:0:6707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788642123.211337:0:6707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788642123.211338:0:6707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788642123.211340:0:6707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788642123.211341:0:6707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788642123.211343:0:6707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788642123.211344:0:6707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788642123.211345:0:6707:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788642123.211347:0:6707:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788642123.211348:0:6707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788642123.211350:0:6707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788642123.211364:0:6707:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788642123.215588:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788642123.215871:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788642123.216077:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788642123.216258:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788642123.216430:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788642123.216708:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788642123.217947:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788642123.434620:0:6707:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788642123.434627:0:6707:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788642123.434653:0:6707:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788642123.434707:0:6707:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.149@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788642123.434733:0:6707:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788642123.434762:0:6707:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788642123.707365:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642124.730622:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642125.754374:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642126.778457:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642127.803549:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642128.570511:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107355392:0@lo:400: 00000100:00100000:3.0:1788642128.570592:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642128.570676:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107355520:0@lo:400: 00000100:00100000:3.0:1788642128.570707:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642128.570742:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642128.570748:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107355648:0@lo:400: 00000100:00100000:3.0:1788642128.570773:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642128.570806:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107355520 00000100:00100000:3.0:1788642128.570813:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107355520 00000100:00100000:3.0:1788642128.570852:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107355648 00000100:00100000:3.0:1788642128.570855:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107355648 00000100:00100000:3.0:1788642128.570880:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788642128.570887:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107355520:12345-0@lo:400: 00000100:00100000:3.0:1788642128.570935:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107355520:12345-0@lo:400: Request processed in 49us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642128.570943:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788642128.570958:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788642128.570964:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107355648:12345-0@lo:400: 00000100:00100000:3.0:1788642128.570989:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107355648:12345-0@lo:400: Request processed in 26us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642128.570995:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788642128.571031:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef151180 x1875527107355648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642128.571044:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef151180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107355648:0@lo:400: 00010000:00080000:3.0:1788642128.571054:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef150380 x1875527107355520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642128.571061:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107355520:0@lo:400: 00000100:00100000:1.0:1788642128.571135:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107355392 00000100:00100000:1.0:1788642128.571140:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107355392 00000100:00100000:1.0:1788642128.571176:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788642128.571192:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:3318:x1875527107355392:12345-0@lo:400: 00000100:00100000:1.0:1788642128.571226:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:3318:x1875527107355392:12345-0@lo:400: Request processed in 37us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642128.571233:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788642128.571636:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107355392:0@lo:400: 00000100:00080000:2.0:1788642128.571805:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788642128.826258:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788642129.595223:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788642129.595231:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dddc599b800 from 21 10000000:01000000:3.0:1788642129.595241:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788642129.595281:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642129.595293:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642129.595304:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642129.595395:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107355776:0@lo:101: 00000100:00100000:3.0:1788642129.595468:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.595519:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642129.595941:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107355776 00000100:00100000:2.0:1788642129.595950:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107355776 00000100:00100000:2.0:1788642129.596010:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788642129.596020:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5858:x1875527107355776:12345-0@lo:101: 00010000:00010000:2.0:1788642129.596036:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642129.596052:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666cfe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666cfdf expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642129.596083:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666cfe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666cfdf expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642129.596094:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666cfe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cfdf expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642129.596132:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f8e00, rc 0) 00000100:00100000:2.0:1788642129.596184:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107355776:12345-0@lo:101: Request processed in 165us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642129.596192:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788642129.596292:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107355776:0@lo:101: 00010000:00010000:3.0:1788642129.596309:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cfe6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642129.596407:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666cfe6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642129.596475:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107355904:0@lo:501: 00000100:00100000:3.0:1788642129.596508:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.596553:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642129.596561:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107355904 00000100:00100000:2.0:1788642129.596565:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107355904 00000100:00100000:2.0:1788642129.596592:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788642129.596600:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107355904:12345-0@lo:501: 00000100:00100000:2.0:1788642129.596874:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107355904:12345-0@lo:501: Request processed in 274us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642129.596882:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788642129.596896:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107355904:0@lo:501: 00000100:00100000:3.0:1788642129.597030:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107356032:0@lo:503: 00000100:00100000:3.0:1788642129.597068:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.597092:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788642129.597182:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107356032 00000100:00100000:1.0:1788642129.597187:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107356032 00000100:00100000:1.0:1788642129.597217:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788642129.597224:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107356032:12345-0@lo:503: 00000100:00100000:1.0:1788642129.597366:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107356032:12345-0@lo:503: Request processed in 142us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642129.597372:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788642129.597494:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107356032:0@lo:503: 00000100:00100000:3.0:1788642129.597860:0:7023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7023:1875527107356160:0@lo:502: 00000100:00100000:3.0:1788642129.597896:0:7023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.597963:0:7023:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72180 going to sleep for 11 seconds 00000100:00100000:2.0:1788642129.597996:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107356160 00000100:00100000:2.0:1788642129.598006:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107356160 00000100:00100000:2.0:1788642129.598066:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788642129.598075:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7023:x1875527107356160:12345-0@lo:502: 00000100:00100000:2.0:1788642129.598271:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7023:x1875527107356160:12345-0@lo:502: Request processed in 197us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642129.598279:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788642129.598383:0:7023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7023:1875527107356160:0@lo:502: 00000100:00100000:1.0:1788642129.598437:0:7023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef151f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7023:1875527107356288:0@lo:502: 00000100:00100000:1.0:1788642129.598468:0:7023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.598725:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107356288 00000100:00100000:3.0:1788642129.598730:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107356288 00000100:00100000:3.0:1788642129.598750:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788642129.598756:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7023:x1875527107356288:12345-0@lo:502: 00000100:00100000:3.0:1788642129.598893:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7023:x1875527107356288:12345-0@lo:502: Request processed in 135us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642129.598900:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788642129.598982:0:7023:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc537c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788642129.598995:0:7023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef151f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7023:1875527107356288:0@lo:502: 00000040:00080000:1.0:1788642129.599013:0:7023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788642129.599365:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788642129.599464:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788642129.599474:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cfe6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642129.599485:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cfe6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642129.599494:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788642129.599497:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dddc599b800 from 4 10000000:01000000:3.0:1788642129.599500:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788642129.599526:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642129.599546:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642129.599557:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642129.599583:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107356416:0@lo:101: 00000100:00100000:3.0:1788642129.599615:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.599680:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788642129.599765:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107356416 00000100:00100000:1.0:1788642129.599770:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107356416 00000100:00100000:1.0:1788642129.599842:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788642129.599850:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107356416:12345-0@lo:101: 00010000:00010000:1.0:1788642129.599860:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642129.599873:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666cff4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666cfed expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642129.599897:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666cff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666cfed expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642129.599915:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666cff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cfed expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642129.599924:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51a00, rc 0) 00000100:00100000:1.0:1788642129.599967:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107356416:12345-0@lo:101: Request processed in 117us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642129.599973:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788642129.600026:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107356416:0@lo:101: 00010000:00010000:3.0:1788642129.600040:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cff4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642129.600049:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666cff4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642129.600089:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107356544:0@lo:256: 00000100:00100000:3.0:1788642129.600137:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.600267:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642129.600306:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107356544 00000100:00100000:2.0:1788642129.600311:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107356544 00000100:00100000:2.0:1788642129.600330:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788642129.600336:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107356544:12345-0@lo:256: 20000000:01000000:2.0:1788642129.600348:0:5854:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788642129.600362:0:5854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788642129.600365:0:5854:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788642129.600449:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107356544:12345-0@lo:256: Request processed in 113us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642129.600455:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788642129.600641:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107356544:0@lo:256: 10000000:01000000:3.0:1788642129.600683:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788642129.600689:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cff4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642129.600697:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666cff4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642129.600704:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788642129.600706:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788642129.600708:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788642129.600725:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642129.600742:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642129.600751:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642129.600763:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107356672:0@lo:101: 00000100:00100000:3.0:1788642129.600787:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.600846:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642129.600876:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107356672 00000100:00100000:2.0:1788642129.600882:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107356672 00000100:00100000:2.0:1788642129.600941:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788642129.600949:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107356672:12345-0@lo:101: 00010000:00010000:2.0:1788642129.600956:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642129.600965:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666cffb expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642129.600981:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666cffb expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642129.600990:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cffb expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642129.601008:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f8400, rc 0) 00000100:00100000:2.0:1788642129.601080:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107356672:12345-0@lo:101: Request processed in 132us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642129.601086:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788642129.601174:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107356672:0@lo:101: 00010000:00010000:3.0:1788642129.601185:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d002 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642129.601192:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d002 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642129.601237:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107356800:0@lo:501: 00000100:00100000:3.0:1788642129.601261:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.601281:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788642129.601290:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107356800 00000100:00100000:3.0:1788642129.601293:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107356800 00000100:00100000:3.0:1788642129.601360:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788642129.601367:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107356800:12345-0@lo:501: 00000100:00100000:3.0:1788642129.601656:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107356800:12345-0@lo:501: Request processed in 289us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642129.601663:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788642129.601907:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107356800:0@lo:501: 00000100:00100000:3.0:1788642129.601940:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107356928:0@lo:503: 00000100:00100000:3.0:1788642129.601977:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.602040:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642129.602072:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107356928 00000100:00100000:2.0:1788642129.602078:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107356928 00000100:00100000:2.0:1788642129.602229:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788642129.602237:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107356928:12345-0@lo:503: 00000100:00100000:2.0:1788642129.602511:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107356928:12345-0@lo:503: Request processed in 274us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642129.602517:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788642129.602588:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107356928:0@lo:503: 00000100:00100000:3.0:1788642129.602953:0:7024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7024:1875527107357056:0@lo:502: 00000100:00100000:3.0:1788642129.602993:0:7024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.603047:0:7024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788642129.603074:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107357056 00000100:00100000:1.0:1788642129.603079:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107357056 00000100:00100000:1.0:1788642129.603226:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788642129.603234:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:7024:x1875527107357056:12345-0@lo:502: 00000100:00100000:1.0:1788642129.605196:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:7024:x1875527107357056:12345-0@lo:502: Request processed in 1952us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642129.605214:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788642129.605347:0:7024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7024:1875527107357056:0@lo:502: 00000020:01000000:2.0:1788642129.605478:0:7024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788642129.605489:0:7024:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788642129.605498:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642129.605500:0:7024:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788642129.605505:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788642129.605511:0:7024:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.149@tcp to nid 0x20000c0a8ca95 (192.168.202.149@tcp) 00000020:01000000:2.0:1788642129.605550:0:7024:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788642129.605553:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788642129.605574:0:7024:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dddfa7c19c0) 00000020:00000080:2.0:1788642129.605596:0:7024:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788642129.605602:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788642129.605697:0:7024:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788642129.605703:0:7024:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788642129.605710:0:7024:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666d010 00010000:00080000:2.0:1788642129.605742:0:7024:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ddcc7102000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.149@tcp at head 00010000:00010000:2.0:1788642129.605972:0:7024:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788642129.665487:0:7024:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788642129.665521:0:7024:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788642129.668742:0:7024:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788642129.668937:0:7024:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788642129.668994:0:7024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788642129.669056:0:7024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788642129.670522:0:7033:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642129.670540:0:7033:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788642129.671732:0:7024:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788642129.671750:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788642129.671793:0:7024:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788642129.671823:0:7024:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4ae1ee156666d017 00000100:00080000:1.0:1788642129.671976:0:7024:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788642129.671984:0:7024:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ddcc7102000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:1.0:1788642129.672037:0:7024:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddef151f80 x1875527107357184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788642129.672141:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107357184:0@lo:8: 00000100:00100000:2.0:1788642129.672302:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.672545:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107357184 00000100:00100000:3.0:1788642129.672557:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107357184 00000100:00100000:3.0:1788642129.672607:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788642129.672615:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1875527107357184:12345-0@lo:8: 00010000:00080000:3.0:1788642129.672640:0:6709:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:3.0:1788642129.672669:0:6709:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4ae1ee156666d01e 00002000:00100000:3.0:1788642129.672707:0:6709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dddff6b2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788642129.672713:0:6709:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788642129.672718:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788642129.672900:0:6709:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788642129.673061:0:6709:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788642129.673089:0:6709:0:(import.c:65:import_set_state_nolock()) ffff8dddefa29000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788642129.673354:0:7024:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788642129.673440:0:7024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642129.673446:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642129.673448:0:7024:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788642129.673452:0:7024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788642129.673456:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642129.673457:0:7024:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788642129.673461:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788642129.673463:0:7024:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788642129.673487:0:7024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7024:1875527107357568:0@lo:502: 00000100:00100000:1.0:1788642129.673549:0:7024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642129.673581:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107357568 00000100:00100000:1.0:1788642129.673585:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107357568 00000100:00100000:1.0:1788642129.673614:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788642129.673621:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:7024:x1875527107357568:12345-0@lo:502: 00000100:00100000:1.0:1788642129.673859:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:7024:x1875527107357568:12345-0@lo:502: Request processed in 238us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642129.673867:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788642129.673906:0:7024:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc49ede40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642129.673930:0:7024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7024:1875527107357568:0@lo:502: 00000020:01000000:1.0:1788642129.673955:0:7024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642129.673959:0:7024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642129.673961:0:7024:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788642129.673965:0:7024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788642129.674027:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788642129.674044:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788642129.674055:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d002 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642129.674076:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d002 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642129.674086:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788642129.674089:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dddc4e04d40 from 1 10000000:01000000:1.0:1788642129.674091:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788642129.674134:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642129.674142:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642129.674150:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642129.674176:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107357696:0@lo:101: 00000100:00100000:1.0:1788642129.674202:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642129.674215:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc49ede40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642129.674233:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107357696 00000100:00100000:1.0:1788642129.674236:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107357696 00000100:00100000:1.0:1788642129.674260:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788642129.674266:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107357696:12345-0@lo:101: 00010000:00010000:1.0:1788642129.674274:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642129.674286:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddcfb50000/0x4ae1ee156666d02c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d025 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642129.674312:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddcfb50000/0x4ae1ee156666d02c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d025 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642129.674332:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddcfb50000/0x4ae1ee156666d02c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d025 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642129.674340:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50000, rc 0) 00000100:00100000:1.0:1788642129.674367:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107357696:12345-0@lo:101: Request processed in 101us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642129.674372:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788642129.674401:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107357696:0@lo:101: 00010000:00010000:1.0:1788642129.674413:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d02c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642129.674422:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d02c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642129.674460:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107357824:0@lo:501: 00000100:00100000:1.0:1788642129.674484:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642129.674496:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc49ede40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642129.674506:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107357824 00000100:00100000:1.0:1788642129.674509:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107357824 00000100:00100000:1.0:1788642129.674542:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788642129.674548:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107357824:12345-0@lo:501: 00000100:00100000:1.0:1788642129.674751:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107357824:12345-0@lo:501: Request processed in 202us (265us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788642129.674757:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788642129.674786:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107357824:0@lo:501: 10000000:01000000:1.0:1788642129.674804:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788642129.674814:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d02c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642129.674822:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d02c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642129.675926:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1875527107357184:12345-0@lo:8: Request processed in 3304us (3617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642129.675938:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788642129.675994:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107357312:0@lo:400: 00000100:00100000:3.0:1788642129.676046:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.676119:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788642129.676126:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107357440:0@lo:400: 00000100:00100000:3.0:1788642129.676149:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642129.676322:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107357312 00000100:00100000:3.0:1788642129.676329:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107357312 00000100:00100000:3.0:1788642129.676364:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107357440 00000100:00100000:3.0:1788642129.676367:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107357440 00000100:00100000:3.0:1788642129.676449:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788642129.676458:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107357312:12345-0@lo:400: 00000100:00100000:3.0:1788642129.676507:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107357312:12345-0@lo:400: Request processed in 51us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642129.676514:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788642129.676543:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788642129.676550:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107357440:12345-0@lo:400: 00000100:00100000:3.0:1788642129.676578:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107357440:12345-0@lo:400: Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642129.676582:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788642129.676618:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddc4e37100 x1875527107357440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642129.676629:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107357440:0@lo:400: 00010000:00080000:3.0:1788642129.676638:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddc4e34a80 x1875527107357312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642129.676646:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107357312:0@lo:400: 00010000:00080000:2.0:1788642129.681981:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef151f80 x1875527107357184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788642139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642129.681997:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788642129.682009:0:3316:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788642129.682018:0:3316:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788642129.682024:0:3316:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788642129.682028:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8ddcc7102000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788642129.684922:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788642129.684939:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef151f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107357184:0@lo:8: 00000004:00080000:2.0:1788642129.684984:0:7033:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788642129.685146:0:7033:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 217146046272ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788642129.743214:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788642129.842644:0:7034:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788642129.842675:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788642129.842682:0:7034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7034:1875527107358080:0@lo:7: 00000100:00100000:0.0:1788642129.842687:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107357952:0@lo:13: 00000100:00100000:2.0:1788642129.844783:0:7034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642129.844837:0:7034:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd7bdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788642129.846690:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107358080 00000100:00100000:1.0:1788642129.846702:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107358080 00000100:00100000:1.0:1788642129.846776:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788642129.846785:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7034:x1875527107358080:12345-0@lo:7: 00000100:00080000:2.0:1788642129.850000:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788642129.850277:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642129.850393:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107357952 00000100:00100000:2.0:1788642129.850402:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107357952 00000100:00100000:2.0:1788642129.850454:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788642129.850463:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1875527107357952:12345-0@lo:13: 00002000:00000024:2.0:1788642129.850491:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788642129.850568:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1875527107357952:12345-0@lo:13: Request processed in 106us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642129.850583:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788642129.850685:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef17d500 x1875527107357952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642129.850702:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107357952:0@lo:13: 00002000:00080000:1.0:1788642129.854997:0:6712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788642129.855007:0:6712:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788642129.855141:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7034:x1875527107358080:12345-0@lo:7: Request processed in 8353us (10361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642129.855154:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788642129.857038:0:7034:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef17ce00 x1875527107358080/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788642145 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642129.857054:0:7034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7034:1875527107358080:0@lo:7: 00000004:00080000:2.0:1788642129.857067:0:7034:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788642129.857136:0:7034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7034:1875527107358208:0@lo:5: 00000100:00100000:2.0:1788642129.857323:0:7034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642129.857380:0:7034:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd7bdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788642129.857497:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107358208 00000100:00100000:0.0:1788642129.857505:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107358208 00000100:00100000:0.0:1788642129.857568:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642129.857577:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7034:x1875527107358208:12345-0@lo:5: 00002000:00080000:0.0:1788642129.857615:0:6711:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788642129.857619:0:6711:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788642129.857949:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7034:x1875527107358208:12345-0@lo:5: Request processed in 372us (625us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788642129.857957:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788642129.858065:0:7034:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef17ce00 x1875527107358208/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788642145 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642129.858078:0:7034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7034:1875527107358208:0@lo:5: 00000004:00080000:2.0:1788642129.858088:0:7034:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788642129.858320:0:7034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7034:1875527107358336:0@lo:700: 00000100:00100000:2.0:1788642129.858353:0:7034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642129.859245:0:7034:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd7bdf00 going to sleep for 11 seconds 00010000:00010000:3.0:1788642129.859506:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642129.861303:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107358336 00000100:00100000:0.0:1788642129.861318:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107358336 00000100:00100000:0.0:1788642129.861523:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788642129.861535:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7034:x1875527107358336:12345-0@lo:700: 00000100:00100000:0.0:1788642129.861595:0:6718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6718:1875527107358464:0@lo:700: 00000100:00100000:0.0:1788642129.861654:0:6718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642129.861691:0:6718:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc70383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788642129.862503:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107358464 00000100:00100000:1.0:1788642129.862511:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107358464 00000100:00100000:1.0:1788642129.862561:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788642129.862569:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6718:x1875527107358464:12345-0@lo:700: 40000000:02000000:1.0:1788642129.900793:0:5868:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788642129.905767:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6718:x1875527107358464:12345-0@lo:700: Request processed in 43188us (44101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642129.905788:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788642129.905885:0:6718:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddc4e37100 x1875527107358464/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788642145 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642129.905902:0:6718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6718:1875527107358464:0@lo:700: 40000000:02000000:0.0:1788642129.905920:0:6718:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1788642129.994987:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788642129.995011:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788642129.995194:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7034:x1875527107358336:12345-0@lo:700: Request processed in 133657us (136835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642129.995214:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788642129.995467:0:7034:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef17dc00 x1875527107358336/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788642145 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642129.995478:0:7034:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788642129.995496:0:7034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7034:1875527107358336:0@lo:700: 00000004:02000040:0.0:1788642130.037961:0:7034:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788642130.048617:0:7034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7034:1875527107358592:0@lo:5: 00000100:00100000:2.0:1788642130.048691:0:7034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642130.048789:0:7034:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc995aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788642130.048882:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107358592 00000100:00100000:3.0:1788642130.048892:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107358592 00000100:00100000:3.0:1788642130.048976:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788642130.048986:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7034:x1875527107358592:12345-0@lo:5: 00002000:00080000:3.0:1788642130.066010:0:6712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788642130.066034:0:6712:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788642130.071623:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7034:x1875527107358592:12345-0@lo:5: Request processed in 22622us (22916us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788642130.071642:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788642130.071925:0:7034:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef17c380 x1875527107358592/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788642146 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642130.071944:0:7034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7034:1875527107358592:0@lo:5: 00000004:00080000:2.0:1788642130.071962:0:7034:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:1.0:1788642130.317730:0:7083:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788642130.883825:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642131.898434:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642132.922276:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642133.946448:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642134.715359:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107358976:0@lo:400: 00000100:00100000:0.0:1788642134.715460:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642134.715539:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788642134.715545:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107358848:0@lo:400: 00000100:00100000:0.0:1788642134.715567:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642134.715598:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107358976 00000100:00100000:0.0:1788642134.715606:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107358976 00000100:00100000:0.0:1788642134.715663:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107358848 00000100:00100000:0.0:1788642134.715666:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107358848 00000100:00100000:0.0:1788642134.715680:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788642134.715688:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107358976:12345-0@lo:400: 00000100:00100000:0.0:1788642134.715742:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107358976:12345-0@lo:400: Request processed in 54us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642134.715749:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788642134.715763:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788642134.715768:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107358848:12345-0@lo:400: 00000100:00100000:0.0:1788642134.715790:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107358848:12345-0@lo:400: Request processed in 22us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642134.715796:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788642134.715814:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788642134.715846:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddc4e35180 x1875527107358848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642134.715861:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107358848:0@lo:400: 00010000:00080000:0.0:1788642134.715873:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddc4e37b80 x1875527107358976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642134.715881:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107358976:0@lo:400: 00000100:00100000:3.0:1788642134.716133:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107358720:0@lo:400: 00000100:00100000:3.0:1788642134.716171:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642134.716210:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788642134.716216:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107359104:0@lo:400: 00000100:00100000:3.0:1788642134.716243:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642134.716382:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107358720 00000100:00100000:1.0:1788642134.716387:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107358720 00000100:00100000:1.0:1788642134.716418:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788642134.716432:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:3320:x1875527107358720:12345-0@lo:400: 00000100:00100000:1.0:1788642134.716473:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:3320:x1875527107358720:12345-0@lo:400: Request processed in 42us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642134.716479:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788642134.716517:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107358720:0@lo:400: 00000100:00100000:0.0:1788642134.716740:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107359104 00000100:00100000:0.0:1788642134.716745:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107359104 00000100:00100000:0.0:1788642134.716826:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788642134.716832:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1875527107359104:12345-0@lo:400: 00000100:00100000:0.0:1788642134.716874:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1875527107359104:12345-0@lo:400: Request processed in 42us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642134.716882:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788642134.716925:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddc4e35c00 x1875527107359104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642134.716938:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107359104:0@lo:400: 00000100:00080000:1.0:1788642134.717074:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788642134.970621:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642135.231781:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107359232:0@lo:13: 00000100:00100000:0.0:1788642135.231875:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642135.232317:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107359232 00000100:00100000:0.0:1788642135.232329:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107359232 00000100:00100000:0.0:1788642135.232383:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788642135.232392:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875527107359232:12345-0@lo:13: 00002000:00000024:0.0:1788642135.232430:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642135.232492:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875527107359232:12345-0@lo:13: Request processed in 101us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642135.232499:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788642135.236261:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddc4e35c00 x1875527107359232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642135.236290:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107359232:0@lo:13: 00000001:00080000:2.0:1788642135.322134:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788642135.996027:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642137.018379:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642138.045216:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642139.066495:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642139.836524:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107359616:0@lo:400: 00000100:00100000:2.0:1788642139.836632:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642139.836704:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642139.836710:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107359488:0@lo:400: 00000100:00100000:2.0:1788642139.836710:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107359744:0@lo:400: 00000100:00100000:2.0:1788642139.836739:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642139.836750:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642139.836769:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788642139.836774:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107359360:0@lo:400: 00000100:00100000:2.0:1788642139.836776:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107359616 00000100:00100000:2.0:1788642139.836783:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107359616 00000100:00100000:3.0:1788642139.836804:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642139.836855:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107359488 00000100:00100000:3.0:1788642139.836858:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107359744 00000100:00100000:2.0:1788642139.836859:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107359488 00000100:00100000:3.0:1788642139.836861:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107359744 00000100:00100000:2.0:1788642139.836881:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788642139.836892:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107359616:12345-0@lo:400: 00000100:00100000:3.0:1788642139.836903:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788642139.836967:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107359616:12345-0@lo:400: Request processed in 76us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642139.836976:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788642139.837001:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788642139.837007:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107359488:12345-0@lo:400: 00000100:00100000:2.0:1788642139.837040:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107359488:12345-0@lo:400: Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642139.837046:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107359744:12345-0@lo:400: 00000100:00100000:2.0:1788642139.837046:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788642139.837079:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107359744:12345-0@lo:400: Request processed in 170us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642139.837085:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788642139.837086:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef17f100 x1875527107359616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642139.837121:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107359616:0@lo:400: 00000100:00100000:3.0:1788642139.837133:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107359360 00000100:00100000:3.0:1788642139.837137:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107359360 00010000:00080000:2.0:1788642139.837143:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef17f800 x1875527107359744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642139.837152:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788642139.837161:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788642139.837162:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107359744:0@lo:400: 00000100:00100000:3.0:1788642139.837167:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:3318:x1875527107359360:12345-0@lo:400: 00000100:00100000:3.0:1788642139.837198:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:3318:x1875527107359360:12345-0@lo:400: Request processed in 31us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642139.837204:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788642139.837245:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107359360:0@lo:400: 00010000:00080000:3.0:1788642139.837257:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef17ca80 x1875527107359488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642139.837266:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107359488:0@lo:400: 00000100:00080000:1.0:1788642139.841087:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788642139.841114:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788642140.091067:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642140.360696:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788642140.360724:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107359872:0@lo:13: 00000100:00100000:2.0:1788642140.360809:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642140.360921:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107359872 00000100:00100000:0.0:1788642140.360930:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107359872 00000100:00100000:0.0:1788642140.361000:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642140.361010:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107359872:12345-0@lo:13: 00002000:00000024:0.0:1788642140.361050:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642140.361140:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107359872:12345-0@lo:13: Request processed in 131us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642140.361147:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788642140.361186:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddc4e35180 x1875527107359872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642140.361205:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107359872:0@lo:13: 00010000:00010000:0.0:1788642141.114508:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642142.139068:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788642142.300572:0:7650:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788642142.300577:0:7650:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788642142.300730:0:7650:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ddcc509b000 00000020:01000004:1.0:1788642142.300749:0:7650:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788642142.300761:0:7650:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788642142.300776:0:7650:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8dddc6343380) 00000020:00000080:1.0:1788642142.300792:0:7650:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788642142.314233:0:7650:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788642142.314574:0:7650:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788642142.333035:0:7650:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788642142.339141:0:7650:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788642142.339184:0:7650:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788642142.339243:0:7650:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788642142.339271:0:7650:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788642142.339705:0:7650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788642142.339719:0:7650:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788642142.339730:0:7650:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4ae1ee156666d03a 00000020:01000004:1.0:1788642142.339740:0:7650:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788642142.339773:0:7650:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.149@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788642142.339777:0:7650:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788642142.339783:0:7650:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788642142.339806:0:7650:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788642142.339809:0:7650:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.149@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788642142.360833:0:7650:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788642142.360871:0:7650:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.149@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788642142.360875:0:7650:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788642142.360877:0:7650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788642142.360878:0:7650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788642142.360879:0:7650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788642142.360880:0:7650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788642142.360882:0:7650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788642142.360883:0:7650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788642142.360885:0:7650:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788642142.360886:0:7650:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788642142.360888:0:7650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788642142.360889:0:7650:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788642142.360893:0:7650:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788642142.360895:0:7650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788642142.360897:0:7650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788642142.360898:0:7650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788642142.360899:0:7650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788642142.360905:0:7650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788642142.360907:0:7650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788642142.360907:0:7650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788642142.360908:0:7650:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788642142.360909:0:7650:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788642142.360910:0:7650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788642142.360911:0:7650:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788642142.360945:0:7650:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788642142.360963:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107360000:0@lo:253: 00000100:00100000:0.0:1788642142.361034:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642142.361188:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd6b1e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788642142.361226:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107360000 00000100:00100000:1.0:1788642142.361233:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107360000 00000100:00100000:1.0:1788642142.361282:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788642142.361291:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:7650:x1875527107360000:12345-0@lo:253: 20000000:01000000:1.0:1788642142.361320:0:5854:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788642142.361324:0:5854:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788642142.361329:0:5854:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788642142.361332:0:5854:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788642142.362125:0:5854:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788642142.362464:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788642142.362480:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788642142.362523:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788642142.362532:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788642142.362581:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788642142.362635:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788642142.363182:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788642142.363201:0:5854:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.149@tcp 20000000:01000000:0.0:1788642142.363203:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.149@tcp (null) (null) (null) 00000040:00080000:0.0:1788642142.363242:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788642142.363251:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788642142.363391:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788642142.363400:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.149@tcp (null) (null) 00000040:00080000:0.0:1788642142.363434:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788642142.363442:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788642142.363466:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788642142.363513:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788642142.364477:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788642142.364500:0:5854:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.149@tcp 20000000:01000000:0.0:1788642142.364502:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.149@tcp (null) (null) (null) 00000040:00080000:0.0:1788642142.364537:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788642142.364545:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788642142.364588:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788642142.364596:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.149@tcp (null) (null) 00000040:00080000:0.0:1788642142.364627:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788642142.364635:0:5854:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788642142.364780:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788642142.364819:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788642142.364835:0:5854:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788642142.364838:0:5854:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788642142.364845:0:5854:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788642142.364846:0:5854:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788642142.364849:0:5854:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788642142.364864:0:5854:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788642142.364867:0:5854:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788642142.364904:0:5854:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788642142.364908:0:5854:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788642142.365853:0:7652:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788642142.365932:0:7652:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788642142.365968:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788642142.366369:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788642142.366418:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788642142.366493:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788642142.366507:0:5854:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788642142.366509:0:5854:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788642142.368760:0:7653:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788642142.368850:0:7653:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788642142.368907:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788642142.371861:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788642142.371915:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788642142.371950:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788642142.371964:0:5854:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788642142.371967:0:5854:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788642142.372857:0:7654:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788642142.372948:0:7654:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788642142.373008:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788642142.373495:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788642142.373540:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788642142.373602:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788642142.373614:0:5854:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788642142.373618:0:5854:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788642142.374370:0:7655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788642142.374614:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788642142.374744:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788642142.374813:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1788642142.374830:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788642142.374849:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.374869:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddcfb51800/0x4ae1ee156666cf92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cf8b expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.374877:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666cfbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cfb5 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.374884:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666cfe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cfdf expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.374891:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d002 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cffb expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.374898:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddcfb50000/0x4ae1ee156666d02c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d025 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.374906:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.374945:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddcfb50000/0x4ae1ee156666d02c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d025 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.374960:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddcfb50000/0x4ae1ee156666d02c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d025 expref: 16 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642142.374974:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e36a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107360128:0@lo:104: 00000100:00100000:0.0:1788642142.375048:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788642142.375427:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666cffb expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.375436:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d002 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666cffb expref: 16 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642142.375445:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107360256:0@lo:104: 00010000:00010000:0.0:1788642142.375473:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666cfe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666cfdf expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.375481:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666cfe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666cfdf expref: 16 pid: 5853 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642142.375490:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107360384:0@lo:104: 00010000:00010000:0.0:1788642142.375514:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666cfbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666cfb5 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.375522:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666cfbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666cfb5 expref: 16 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642142.375530:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107360512:0@lo:104: 00010000:00010000:0.0:1788642142.375572:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddcfb51800/0x4ae1ee156666cf92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666cf8b expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.375581:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddcfb51800/0x4ae1ee156666cf92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666cf8b expref: 16 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642142.375589:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107360640:0@lo:104: 00000100:00100000:0.0:1788642142.375618:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd6b1e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788642142.375743:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788642142.375763:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642142.375828:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642142.375885:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642142.375906:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107360128 00000100:00100000:3.0:1788642142.375914:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107360128 00000100:00100000:3.0:1788642142.375951:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107360256 00000100:00100000:3.0:1788642142.375954:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107360256 00000100:00100000:3.0:1788642142.375964:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107360384 00000100:00100000:3.0:1788642142.375966:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107360384 00000100:00100000:3.0:1788642142.375978:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788642142.375986:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc59cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:5854:x1875527107360128:12345-0@lo:104: 00010000:00010000:3.0:1788642142.376000:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d02c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.376136:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788642142.376143:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc59cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:5854:x1875527107360128:12345-0@lo:104: Request processed in 157us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642142.376151:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788642142.376191:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788642142.376198:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:5854:x1875527107360256:12345-0@lo:104: 00010000:00010000:3.0:1788642142.376206:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d002 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.376240:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788642142.376244:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:5854:x1875527107360256:12345-0@lo:104: Request processed in 49us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642142.376251:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788642142.376263:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788642142.376269:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5854:x1875527107360384:12345-0@lo:104: 00010000:00010000:3.0:1788642142.376276:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cfe6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.376381:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788642142.376388:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d02c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.376395:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50400 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:1.0:1788642142.376399:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d02c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.376408:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d02c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788642142.376415:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d02c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642142.376421:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788642142.376451:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d02c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.376468:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788642142.376487:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d02c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.376494:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d02c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.376505:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642142.376508:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d002 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.376514:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121a00 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:1.0:1788642142.376518:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d002 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.376524:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d002 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788642142.376530:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d002 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642142.376535:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788642142.376557:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d002 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.376564:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788642142.376578:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d002 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.376584:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddd6121a00/0x4ae1ee156666cffb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d002 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.376603:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642142.376605:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642142.376607:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642142.376621:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107360768:0@lo:103: 00000100:00100000:1.0:1788642142.376866:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.376910:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788642142.376918:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107360896:0@lo:103: 00000100:00100000:1.0:1788642142.376954:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642142.377017:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642142.377027:0:5844:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788642142.377033:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1788642142.377286:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788642142.377300:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5854:x1875527107360384:12345-0@lo:104: Request processed in 1031us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642142.377308:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788642142.377322:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107360512 00000100:00100000:3.0:1788642142.377328:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107360512 00000100:00100000:3.0:1788642142.377346:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107360640 00000100:00100000:3.0:1788642142.377349:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107360640 00000100:00100000:3.0:1788642142.377359:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788642142.377372:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:5854:x1875527107360512:12345-0@lo:104: 00010000:00010000:3.0:1788642142.377382:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cfbc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.377414:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788642142.377419:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:5854:x1875527107360512:12345-0@lo:104: Request processed in 49us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642142.377424:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788642142.377437:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788642142.377443:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5854:x1875527107360640:12345-0@lo:104: 00010000:00010000:3.0:1788642142.377450:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cf92 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.377478:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788642142.377483:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5854:x1875527107360640:12345-0@lo:104: Request processed in 41us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642142.377489:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788642142.377505:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788642142.377509:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cfe6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.377516:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121600 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642142.377520:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666cfe6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.377527:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666cfe6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788642142.377534:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666cfe6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642142.377546:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788642142.377564:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cfe6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.377569:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642142.377584:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cfe6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.377591:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666cfdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cfe6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.377602:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788642142.377605:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cfbc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.377611:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9000 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642142.377614:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666cfbc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.377622:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666cfbc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788642142.377628:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666cfbc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642142.377633:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788642142.377805:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642142.377906:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cfbc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.377912:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642142.377934:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cfbc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.377940:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666cfb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cfbc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.377951:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642142.377953:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642142.377955:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642142.377970:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107360768 00000100:00100000:3.0:1788642142.377973:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107360768 00010000:00010000:3.0:1788642142.377992:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddcfb50000/0x4ae1ee156666d02c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d025 expref: 17 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642142.378011:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107360896 00000100:00100000:3.0:1788642142.378014:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107360896 00010000:00010000:3.0:1788642142.378026:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d002 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cffb expref: 18 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642142.378036:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788642142.378042:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef153800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:3318:x1875527107360768:12345-0@lo:103: 00010000:00010000:3.0:1788642142.378052:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642142.378058:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddcfb50000/0x4ae1ee156666d02c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d025 expref: 18 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.378068:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddcfb50000/0x4ae1ee156666d02c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d025 expref: 18 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.378085:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642142.378134:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef153800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:3318:x1875527107360768:12345-0@lo:103: Request processed in 92us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642142.378149:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788642142.378162:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788642142.378168:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:3320:x1875527107360896:12345-0@lo:103: 00010000:00010000:3.0:1788642142.378175:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642142.378180:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d002 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cffb expref: 17 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.378189:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d002 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666cffb expref: 17 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.378198:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642142.378223:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef152a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:3320:x1875527107360896:12345-0@lo:103: Request processed in 56us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642142.378229:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788642142.378258:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107361024:0@lo:103: 00000100:00100000:3.0:1788642142.378474:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642142.378698:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef153100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107360896:0@lo:103: 00000100:00100000:3.0:1788642142.378731:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107361152:0@lo:103: 00000100:00100000:3.0:1788642142.378754:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642142.378924:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107360768:0@lo:103: 00010000:00010000:2.0:1788642142.378993:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642142.379000:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cf92 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.379008:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121000 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:2.0:1788642142.379011:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666cf92 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.379018:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666cf92 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788642142.379025:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666cf92 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788642142.379030:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788642142.379049:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cf92 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.379054:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788642142.379071:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cf92 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.379078:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666cf8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cf92 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.379094:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642142.379096:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642142.379118:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642142.379127:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107361280:0@lo:103: 00010000:00010000:2.0:1788642142.379154:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642142.379157:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642142.379241:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddcfb50000/0x4ae1ee156666d02c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d025 expref: 16 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642142.379251:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e36a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107360128:0@lo:104: 00010000:00010000:0.0:1788642142.379262:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d002 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666cffb expref: 15 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642142.379271:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107360256:0@lo:104: 00000100:00100000:0.0:1788642142.379279:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107360384:0@lo:104: 00000100:00100000:0.0:1788642142.379358:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107360512:0@lo:104: 00000100:00100000:0.0:1788642142.379376:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5854:1875527107360640:0@lo:104: 00010000:00010000:0.0:1788642142.379396:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642142.379623:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107361024 00000100:00100000:1.0:1788642142.379633:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107361024 00010000:00010000:1.0:1788642142.379674:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666cfe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cfdf expref: 15 pid: 5853 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642142.379714:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642142.379876:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107361152 00000100:00100000:2.0:1788642142.379880:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107361152 00010000:00010000:2.0:1788642142.379897:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666cfbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cfb5 expref: 16 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642142.379911:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107361280 00000100:00100000:2.0:1788642142.379913:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107361280 00010000:00010000:2.0:1788642142.379923:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddcfb51800/0x4ae1ee156666cf92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cf8b expref: 17 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642142.379935:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788642142.379941:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:3320:x1875527107361024:12345-0@lo:103: 00010000:00010000:2.0:1788642142.379951:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642142.379956:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666cfe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cfdf expref: 17 pid: 5853 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.379966:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666cfe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666cfdf expref: 17 pid: 5853 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.379989:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666cfe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666cfdf expref: 17 pid: 5853 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380000:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642142.380045:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:3320:x1875527107361024:12345-0@lo:103: Request processed in 104us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.380051:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788642142.380066:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788642142.380072:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:3317:x1875527107361152:12345-0@lo:103: 00010000:00010000:2.0:1788642142.380079:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642142.380084:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666cfbc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cfb5 expref: 15 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380092:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666cfbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666cfb5 expref: 15 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380126:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666cfbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666cfb5 expref: 15 pid: 5854 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380134:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642142.380161:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:3317:x1875527107361152:12345-0@lo:103: Request processed in 90us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.380167:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788642142.380184:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788642142.380190:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:3318:x1875527107361280:12345-0@lo:103: 00010000:00010000:2.0:1788642142.380197:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642142.380201:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddcfb51800/0x4ae1ee156666cf92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cf8b expref: 13 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380217:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddcfb51800/0x4ae1ee156666cf92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666cf8b expref: 13 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380227:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddcfb51800/0x4ae1ee156666cf92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666cf8b expref: 13 pid: 5856 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380238:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380247:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380261:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380268:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380275:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380282:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380299:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642142.380304:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380311:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380338:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380352:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642142.380381:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:3318:x1875527107361280:12345-0@lo:103: Request processed in 192us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.380387:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788642142.380416:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107361280:0@lo:103: 00010000:00010000:2.0:1788642142.380434:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380441:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.380447:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d041 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788642142.380464:0:5854:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788642142.380772:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107361024:0@lo:103: 00000100:00100000:2.0:1788642142.384201:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107361152:0@lo:103: 00000100:00100000:0.0:1788642142.468941:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:7650:x1875527107360000:12345-0@lo:253: Request processed in 107635us (107890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642142.468961:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788642142.469557:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107360000:0@lo:253: 10000000:01000000:1.0:1788642142.469575:0:7650:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788642142.469579:0:7650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788642142.469581:0:7650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788642142.469582:0:7650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788642142.469583:0:7650:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788642142.469584:0:7650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788642142.469585:0:7650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788642142.469586:0:7650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788642142.469588:0:7650:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788642142.469589:0:7650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788642142.469590:0:7650:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788642142.469611:0:7650:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ddcc509b000 from lustre-OST0001 10000000:01000000:1.0:1788642142.469646:0:7650:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788642142.469658:0:7650:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788642142.469668:0:7650:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dddc4e04d40 local copy 10000000:01000000:1.0:1788642142.469693:0:7650:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788642142.469738:0:7650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.469750:0:7650:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.469761:0:7650:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642142.469778:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107361408:0@lo:101: 00000100:00100000:1.0:1788642142.469835:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.469903:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc7038600 going to sleep for 11 seconds 00000100:00100000:2.0:1788642142.470082:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107361408 00000100:00100000:2.0:1788642142.470089:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107361408 00000100:00100000:2.0:1788642142.470160:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788642142.470170:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+11:7650:x1875527107361408:12345-0@lo:101: 00010000:00010000:2.0:1788642142.470183:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642142.470197:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d04f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d048 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.470220:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d04f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d048 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.470238:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d04f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d048 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.470246:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f8e00, rc 0) 00000100:00100000:2.0:1788642142.470302:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107361408:12345-0@lo:101: Request processed in 134us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.470309:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788642142.470629:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107361408:0@lo:101: 00010000:00010000:1.0:1788642142.470664:0:7650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4ae1ee156666d04f expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.470674:0:7650:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4ae1ee156666d04f expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642142.470772:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107361536:0@lo:501: 00000100:00100000:1.0:1788642142.470813:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.470885:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc7038600 going to sleep for 11 seconds 00000100:00100000:0.0:1788642142.471849:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107361536 00000100:00100000:0.0:1788642142.471857:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107361536 00000100:00100000:0.0:1788642142.471905:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788642142.471914:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107361536:12345-0@lo:501: 00000100:00100000:0.0:1788642142.472146:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107361536:12345-0@lo:501: Request processed in 233us (1331us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788642142.472154:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788642142.472323:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107361536:0@lo:501: 10000000:01000000:1.0:1788642142.472344:0:7650:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788642142.472374:0:7650:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788642142.472380:0:7650:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4ae1ee156666d04f expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.472398:0:7650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4ae1ee156666d04f expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.472417:0:7650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4ae1ee156666d04f expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.472442:0:7650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788642142.472592:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642142.472600:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4ae1ee156666d04f expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.472607:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50400 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642142.472611:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4ae1ee156666d04f expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.472632:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x4ae1ee156666d04f expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788642142.472658:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x4ae1ee156666d04f expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642142.472664:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788642142.472689:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4ae1ee156666d04f expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.472695:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642142.472727:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4ae1ee156666d04f expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.472735:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50400/0x4ae1ee156666d048 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4ae1ee156666d04f expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.472757:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642142.472759:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642142.472761:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642142.472872:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107361664:0@lo:103: 00000100:00100000:2.0:1788642142.472912:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1788642142.473040:0:7650:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ddcc509b000 10000000:01000000:1.0:1788642142.473046:0:7650:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788642142.473051:0:7650:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788642142.473054:0:7650:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788642142.473058:0:7650:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788642142.473061:0:7650:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788642142.473082:0:7650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.473091:0:7650:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.473139:0:7650:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642142.473153:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107361792:0@lo:101: 00000100:00100000:1.0:1788642142.473181:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.473198:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc70389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642142.473250:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107361792 00000100:00100000:0.0:1788642142.473255:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107361792 00000100:00100000:0.0:1788642142.473300:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788642142.473308:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107361792:12345-0@lo:101: 00010000:00010000:0.0:1788642142.473318:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642142.473329:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d05d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d056 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.473349:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d05d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d056 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.473360:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d05d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d056 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.473369:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833000, rc 0) 00000100:00100000:0.0:1788642142.473407:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7650:x1875527107361792:12345-0@lo:101: Request processed in 99us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642142.473413:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788642142.473712:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107361792:0@lo:101: 00010000:00010000:1.0:1788642142.473727:0:7650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d05d expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.473748:0:7650:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d05d expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642142.473827:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107361920:0@lo:501: 00000100:00100000:1.0:1788642142.473853:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.473918:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc70389c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642142.473998:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107361664 00000100:00100000:3.0:1788642142.474003:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107361664 00000100:00100000:3.0:1788642142.474043:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788642142.474051:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:3319:x1875527107361664:12345-0@lo:103: 00010000:00010000:3.0:1788642142.474061:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642142.474074:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d04f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666d048 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.474085:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642142.474149:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:3319:x1875527107361664:12345-0@lo:103: Request processed in 98us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642142.474155:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788642142.474184:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107361664:0@lo:103: 00000100:00100000:2.0:1788642142.475275:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107361920 00000100:00100000:2.0:1788642142.475294:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107361920 00000100:00100000:2.0:1788642142.475386:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788642142.475397:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107361920:12345-0@lo:501: 00000100:00100000:2.0:1788642142.476044:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107361920:12345-0@lo:501: Request processed in 647us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.476053:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788642142.476165:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107361920:0@lo:501: 00000100:00100000:1.0:1788642142.476210:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362048:0@lo:503: 00000100:00100000:1.0:1788642142.476256:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.479324:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc70389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642142.479574:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107362048 00000100:00100000:0.0:1788642142.479584:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107362048 00000100:00100000:3.0:1788642142.480124:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788642142.480136:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107362048:12345-0@lo:503: 00000100:00100000:3.0:1788642142.480389:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107362048:12345-0@lo:503: Request processed in 254us (4132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642142.480398:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788642142.480715:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362048:0@lo:503: 00000040:00080000:1.0:1788642142.480997:0:7650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788642142.481069:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362176:0@lo:502: 00000100:00100000:1.0:1788642142.481144:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.481699:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc70389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642142.481843:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107362176 00000100:00100000:2.0:1788642142.481851:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107362176 00000100:00100000:2.0:1788642142.481893:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788642142.481901:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107362176:12345-0@lo:502: 00000100:00100000:2.0:1788642142.482138:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107362176:12345-0@lo:502: Request processed in 238us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.482148:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788642142.482259:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362176:0@lo:502: 00000040:00080000:1.0:1788642142.486787:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788642142.486896:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788642142.486929:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788642142.486978:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788642142.487019:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788642142.487054:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788642142.488414:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362304:0@lo:502: 00000100:00100000:1.0:1788642142.488517:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.488690:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc70389c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642142.488841:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107362304 00000100:00100000:3.0:1788642142.488849:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107362304 00000100:00100000:2.0:1788642142.491335:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788642142.491360:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107362304:12345-0@lo:502: 00000100:00100000:2.0:1788642142.491939:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107362304:12345-0@lo:502: Request processed in 590us (3419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.491949:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788642142.492417:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362304:0@lo:502: 00000040:00080000:1.0:1788642142.492570:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788642142.492586:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788642142.493362:0:7660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788642142.493371:0:7660:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788642142.493378:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642142.493380:0:7660:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788642142.493385:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788642142.493416:0:7660:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8dddeff419c0) 00000020:00000080:1.0:1788642142.493438:0:7660:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788642142.493445:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788642142.493506:0:7660:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ddcc509b000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788642142.493513:0:7660:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788642142.493519:0:7660:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4ae1ee156666d06b 00010000:00010000:1.0:1788642142.498728:0:7660:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788642142.499320:0:7660:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788642142.503020:0:7660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788642142.503556:0:7660:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788642142.508954:0:7660:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788642142.509944:0:7660:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788642142.511339:0:7660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788642142.511353:0:7660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642142.511360:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642142.511362:0:7660:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788642142.511365:0:7660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788642142.511369:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642142.511370:0:7660:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788642142.511373:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788642142.511375:0:7660:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788642142.511418:0:7660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642142.511421:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642142.511423:0:7660:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788642142.511432:0:7660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788642142.514173:0:7650:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788642142.514215:0:7650:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788642142.514241:0:7650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d05d expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.514254:0:7650:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d05d expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642142.514262:0:7650:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ddcc509b000 from 1 10000000:01000000:1.0:1788642142.514265:0:7650:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788642142.514314:0:7650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.514323:0:7650:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.514334:0:7650:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642142.514358:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362432:0@lo:101: 00000100:00100000:1.0:1788642142.514425:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.514464:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788642142.514538:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107362432 00000100:00100000:3.0:1788642142.514545:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107362432 00000100:00100000:3.0:1788642142.514591:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788642142.514611:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:7650:x1875527107362432:12345-0@lo:101: 00010000:00010000:3.0:1788642142.514623:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642142.514643:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666d079 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d072 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.514674:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666d079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d072 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.514685:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666d079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d072 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.514693:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121600, rc 0) 00000100:00100000:3.0:1788642142.514729:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7650:x1875527107362432:12345-0@lo:101: Request processed in 130us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642142.514747:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788642142.518390:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362432:0@lo:101: 00010000:00010000:1.0:1788642142.518431:0:7650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d079 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.518447:0:7650:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d079 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642142.518606:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362560:0@lo:501: 00000100:00100000:1.0:1788642142.518680:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.518726:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788642142.519992:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107362560 00000100:00100000:2.0:1788642142.520008:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107362560 00000100:00100000:2.0:1788642142.520082:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788642142.520094:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7650:x1875527107362560:12345-0@lo:501: 00000100:00100000:2.0:1788642142.520469:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7650:x1875527107362560:12345-0@lo:501: Request processed in 376us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.520477:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788642142.520744:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362560:0@lo:501: 00000100:00100000:1.0:1788642142.520788:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362688:0@lo:503: 00000100:00100000:1.0:1788642142.520834:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.520861:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788642142.520925:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107362688 00000100:00100000:0.0:1788642142.520931:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107362688 00000100:00100000:0.0:1788642142.520969:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788642142.520978:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7650:x1875527107362688:12345-0@lo:503: 00000100:00100000:0.0:1788642142.521304:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7650:x1875527107362688:12345-0@lo:503: Request processed in 327us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642142.521312:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788642142.521742:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362688:0@lo:503: 00000040:00080000:1.0:1788642142.522057:0:7650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788642142.522160:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362816:0@lo:502: 00000100:00100000:1.0:1788642142.522217:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.522245:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788642142.522335:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107362816 00000100:00100000:2.0:1788642142.522341:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107362816 00000100:00100000:2.0:1788642142.522382:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788642142.522391:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7650:x1875527107362816:12345-0@lo:502: 00000100:00100000:2.0:1788642142.522589:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7650:x1875527107362816:12345-0@lo:502: Request processed in 199us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.522598:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788642142.522832:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362816:0@lo:502: 00000040:00080000:1.0:1788642142.523271:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788642142.524238:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788642142.524368:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362944:0@lo:502: 00000100:00100000:1.0:1788642142.524457:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.524499:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788642142.524528:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107362944 00000100:00100000:1.0:1788642142.524535:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107362944 00000100:00100000:1.0:1788642142.524582:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788642142.524591:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7650:x1875527107362944:12345-0@lo:502: 00000100:00100000:1.0:1788642142.524795:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7650:x1875527107362944:12345-0@lo:502: Request processed in 204us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642142.524811:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788642142.524865:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107362944:0@lo:502: 00000040:00080000:1.0:1788642142.524967:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788642142.524978:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788642142.530532:0:7664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788642142.530547:0:7664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642142.530550:0:7664:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788642142.530558:0:7664:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ddcc509b000 00000020:00000080:2.0:1788642142.530561:0:7664:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788642142.530586:0:7664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642142.530590:0:7664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642142.530592:0:7664:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788642142.530595:0:7664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788642142.530749:0:7650:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788642142.530780:0:7650:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788642142.530802:0:7650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d079 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.530815:0:7650:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d079 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642142.530862:0:7650:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788642142.530866:0:7650:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ddcc509b000 10000000:01000000:1.0:1788642142.530870:0:7650:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ddcc509b000 10000000:01000000:1.0:1788642142.530875:0:7650:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788642142.530881:0:7650:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ddcc509b000 from 1 10000000:01000000:1.0:1788642142.530884:0:7650:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788642142.530930:0:7650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.530939:0:7650:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.530952:0:7650:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642142.530977:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107363072:0@lo:101: 00000100:00100000:1.0:1788642142.531365:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.531471:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642142.538360:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107363072 00000100:00100000:0.0:1788642142.538379:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107363072 00000100:00100000:1.0:1788642142.543977:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788642142.543994:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7650:x1875527107363072:12345-0@lo:101: 00010000:00010000:1.0:1788642142.544022:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642142.544041:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddcfb51e00/0x4ae1ee156666d087 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d080 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.544071:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddcfb51e00/0x4ae1ee156666d087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d080 expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.544083:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddcfb51e00/0x4ae1ee156666d087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d080 expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642142.544093:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51e00, rc 0) 00000100:00100000:1.0:1788642142.544201:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7650:x1875527107363072:12345-0@lo:101: Request processed in 210us (12836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642142.544208:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788642142.544378:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107363072:0@lo:101: 00010000:00010000:3.0:1788642142.544397:0:7650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d087 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.544407:0:7650:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d087 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642142.544520:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107363200:0@lo:501: 00000100:00100000:3.0:1788642142.544553:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642142.544579:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788642142.544721:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107363200 00000100:00100000:2.0:1788642142.544727:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107363200 00000100:00100000:2.0:1788642142.544769:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788642142.544788:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7650:x1875527107363200:12345-0@lo:501: 00000100:00100000:2.0:1788642142.545025:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7650:x1875527107363200:12345-0@lo:501: Request processed in 239us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.545033:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788642142.545131:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107363200:0@lo:501: 00000100:00100000:3.0:1788642142.545158:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107363328:0@lo:503: 00000100:00100000:3.0:1788642142.545196:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642142.545215:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788642142.545268:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107363328 00000100:00100000:2.0:1788642142.545273:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107363328 00000100:00100000:2.0:1788642142.545313:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788642142.545321:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7650:x1875527107363328:12345-0@lo:503: 00000100:00100000:2.0:1788642142.545469:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7650:x1875527107363328:12345-0@lo:503: Request processed in 148us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.545476:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788642142.545605:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107363328:0@lo:503: 00000040:00080000:3.0:1788642142.545913:0:7650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788642142.545970:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107363456:0@lo:502: 00000100:00100000:3.0:1788642142.546011:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642142.546039:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788642142.546212:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107363456 00000100:00100000:2.0:1788642142.546218:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107363456 00000100:00100000:2.0:1788642142.546247:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788642142.546254:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7650:x1875527107363456:12345-0@lo:502: 00000100:00100000:2.0:1788642142.546441:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7650:x1875527107363456:12345-0@lo:502: Request processed in 186us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.546448:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788642142.547232:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107363456:0@lo:502: 00000040:00080000:1.0:1788642142.547553:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788642142.547620:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788642142.547665:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788642142.547744:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788642142.547782:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788642142.547839:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788642142.547872:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788642142.547901:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788642142.547942:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788642142.547979:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788642142.548027:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788642142.548078:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788642142.548165:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788642142.548203:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788642142.548254:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788642142.548291:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788642142.548343:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788642142.548394:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788642142.548427:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788642142.548477:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788642142.548525:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788642142.548561:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788642142.548594:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788642142.548643:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788642142.548702:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788642142.548738:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788642142.548790:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788642142.548826:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788642142.548857:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788642142.548907:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788642142.548943:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788642142.548979:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788642142.549015:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788642142.549065:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788642142.549144:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788642142.549230:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788642142.549270:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788642142.549323:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107363584:0@lo:502: 00000100:00100000:1.0:1788642142.549408:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.549458:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642142.549772:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107363584 00000100:00100000:0.0:1788642142.549780:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107363584 00000100:00100000:0.0:1788642142.549846:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788642142.549856:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7650:x1875527107363584:12345-0@lo:502: 00000100:00100000:0.0:1788642142.550151:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7650:x1875527107363584:12345-0@lo:502: Request processed in 296us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642142.550159:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788642142.555689:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107363584:0@lo:502: 00000040:00080000:1.0:1788642142.555868:0:7650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788642142.555889:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788642142.558561:0:7665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788642142.558582:0:7665:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8dddfd7d8000) 00000020:00000080:3.0:1788642142.558623:0:7665:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788642142.558704:0:7665:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ddcc509b000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788642142.558709:0:7665:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ddcc509b000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788642142.558711:0:7665:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ddcc509b000 3 00010000:00080000:3.0:1788642142.558748:0:7665:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ddcc65ca800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.149@tcp at head 00010000:00010000:2.0:1788642142.563612:0:7665:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788642142.563951:0:7665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788642142.564008:0:7665:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788642142.564023:0:7665:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4ae1ee156666d095 00000100:00080000:2.0:1788642142.564035:0:7665:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788642142.564042:0:7665:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ddcc65ca800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788642142.564086:0:7665:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddef17d880 x1875527107363712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788642142.565380:0:7665:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788642142.565487:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1875527107363712:0@lo:38: 00000100:00100000:0.0:1788642142.565576:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788642142.565923:0:7665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1788642142.566091:0:7666:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8dddfacf0700 x1875527107363840/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642142.566126:0:7666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd6b1e840 going to sleep for 0 seconds 00000100:00100000:2.0:1788642142.566207:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107363712 00000100:00100000:2.0:1788642142.566216:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107363712 00000100:00100000:1.0:1788642142.566402:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107363968:0@lo:400: 00000100:00100000:1.0:1788642142.566442:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642142.570240:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107364096:0@lo:400: 00000020:01000000:3.0:1788642142.570346:0:7650:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788642142.570391:0:7650:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788642142.570412:0:7650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d087 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642142.570424:0:7650:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d087 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788642142.570485:0:7650:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788642142.570487:0:7650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788642142.570489:0:7650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642142.570490:0:7650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642142.570491:0:7650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642142.570493:0:7650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642142.570494:0:7650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788642142.570495:0:7650:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788642142.570497:0:7650:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788642142.570499:0:7650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642142.570500:0:7650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788642142.570504:0:7650:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788642142.570506:0:7650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788642142.570507:0:7650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788642142.570509:0:7650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642142.570510:0:7650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642142.570511:0:7650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642142.570512:0:7650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642142.570513:0:7650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788642142.570514:0:7650:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788642142.570515:0:7650:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788642142.570516:0:7650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642142.570517:0:7650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788642142.570545:0:7650:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788642142.570558:0:7650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107364352:0@lo:253: 00000100:00100000:3.0:1788642142.570601:0:7650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642142.570659:0:7650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642142.576952:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107364224:0@lo:400: 00000100:00100000:1.0:1788642142.577026:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642142.577061:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642142.577691:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107363968 00000100:00100000:2.0:1788642142.577703:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107363968 00000100:00100000:2.0:1788642142.577763:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788642142.577772:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107363968:12345-0@lo:400: 00000100:00100000:2.0:1788642142.577856:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef153100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107363968:12345-0@lo:400: Request processed in 85us (11413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.577863:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788642142.577883:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788642142.577888:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1875527107363712:12345-0@lo:38: 00010000:00080000:2.0:1788642142.577913:0:5863:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:2.0:1788642142.577955:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4ae1ee156666d09c 00000004:00100000:2.0:1788642142.577972:0:5863:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788642142.578023:0:5863:0:(import.c:65:import_set_state_nolock()) ffff8dddeff01000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788642142.578070:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875527107363712:12345-0@lo:38: Request processed in 180us (12493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.578076:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788642142.579636:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef17d880 x1875527107363712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788642152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642142.579658:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788642142.579668:0:3316:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788642142.579677:0:3316:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788642142.579683:0:3316:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788642142.579687:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8ddcc65ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788642142.579696:0:3316:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008f33f3f5): req@ffff8dddfacf0700 x1875527107363840/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642142.579737:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1875527107363712:0@lo:38: 00000100:00100000:2.0:1788642142.579777:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107364352 00000100:00100000:2.0:1788642142.579784:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107364352 00000100:00100000:2.0:1788642142.579824:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788642142.579832:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7650:x1875527107364352:12345-0@lo:253: 20000000:01000000:2.0:1788642142.579860:0:5856:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788642142.579877:0:5856:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788642142.580697:0:7666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642142.580731:0:7666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd6b1e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788642142.581058:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107364224 00000100:00100000:1.0:1788642142.581070:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107364224 00000100:00100000:1.0:1788642142.581147:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788642142.581157:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107364224:12345-0@lo:400: 00000100:00100000:1.0:1788642142.581213:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107364224:12345-0@lo:400: Request processed in 59us (4188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642142.581220:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788642142.581265:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788642142.581390:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107364096 00000100:00100000:0.0:1788642142.581397:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107364096 00010000:00080000:1.0:1788642142.581875:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef150a80 x1875527107364224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642142.581890:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107364224:0@lo:400: 00000100:00100000:3.0:1788642142.582251:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107363840 00000100:00100000:3.0:1788642142.582258:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107363840 00000100:00100000:0.0:1788642142.582429:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788642142.582440:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107364096:12345-0@lo:400: 00000100:00100000:0.0:1788642142.582502:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef152680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107364096:12345-0@lo:400: Request processed in 65us (5440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642142.582509:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788642142.584804:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788642142.584822:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7666:x1875527107363840:12345-0@lo:901: 00000100:00100000:3.0:1788642142.585603:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7666:x1875527107363840:12345-0@lo:901: Request processed in 782us (4903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642142.585615:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788642142.591456:0:7666:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddfacf0700 x1875527107363840/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788642158 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642142.591474:0:7666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf0700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7666:1875527107363840:0@lo:901: 00000100:00080000:1.0:1788642142.591742:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788642142.591780:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef150000 x1875527107363968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642142.591791:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107363968:0@lo:400: 00010000:00080000:1.0:1788642142.591831:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddef152d80 x1875527107364096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642142.591840:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107364096:0@lo:400: 20000000:01000000:2.0:1788642142.617167:0:5856:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788642142.617188:0:5856:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788642142.618647:0:5877:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788642142.618656:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788642142.618693:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.618710:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666cff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cfed expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.618718:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.618761:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666cff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666cfed expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642142.618774:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666cff4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666cfed expref: 14 pid: 5853 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642142.618788:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1875527107364480:0@lo:104: 00000100:00100000:0.0:1788642142.618862:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642142.618920:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd6b1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788642142.619062:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107364480 00000100:00100000:2.0:1788642142.619071:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107364480 00000100:00100000:2.0:1788642142.619149:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788642142.619160:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5877:x1875527107364480:12345-0@lo:104: 00010000:00010000:2.0:1788642142.619174:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cff4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619246:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788642142.619253:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:5877:x1875527107364480:12345-0@lo:104: Request processed in 96us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.619260:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788642142.619387:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1875527107364480:0@lo:104: 00010000:00010000:1.0:1788642142.619414:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619479:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788642142.619487:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cff4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619494:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121200 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:2.0:1788642142.619499:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666cff4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619520:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666cff4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788642142.619528:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666cff4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788642142.619535:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788642142.619569:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cff4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619575:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788642142.619604:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cff4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619611:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddd6121200/0x4ae1ee156666cfed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cff4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619630:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642142.619632:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642142.619634:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642142.619661:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107364608:0@lo:103: 00000100:00100000:2.0:1788642142.619696:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642142.619738:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107364608 00000100:00100000:2.0:1788642142.619743:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107364608 00010000:00010000:2.0:1788642142.619761:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666cff4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cfed expref: 15 pid: 5853 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642142.619785:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788642142.619792:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddde4e66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:3319:x1875527107364608:12345-0@lo:103: 00010000:00010000:2.0:1788642142.619811:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642142.619819:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666cff4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cfed expref: 15 pid: 5853 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619831:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666cff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666cfed expref: 15 pid: 5853 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619847:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666cff4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666cfed expref: 15 pid: 5853 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619864:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619874:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788642142.619890:0:5847:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001527261s 00010000:00010000:2.0:1788642142.619895:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619904:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619912:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619918:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619924:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9832000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642142.619930:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619945:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619961:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.619971:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642142.620002:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddde4e66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:3319:x1875527107364608:12345-0@lo:103: Request processed in 211us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642142.620009:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788642142.620076:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107364608:0@lo:103: 00010000:00010000:2.0:1788642142.620094:0:5877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.620132:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642142.620138:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9832000/0x4ae1ee156666d0a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642142.637077:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:7650:x1875527107364352:12345-0@lo:253: Request processed in 57236us (66467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642142.637093:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788642142.637238:0:7650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae59d524-c809-4baa-a38f-29c60bd72e4e:7650:1875527107364352:0@lo:253: 10000000:01000000:3.0:1788642142.637254:0:7650:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788642142.637262:0:7650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788642142.637265:0:7650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788642142.637266:0:7650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642142.637267:0:7650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642142.637268:0:7650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642142.637269:0:7650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642142.637270:0:7650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788642142.637271:0:7650:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788642142.637282:0:7650:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788642142.637284:0:7650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642142.637285:0:7650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788642142.637302:0:7650:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788642142.645676:0:7650:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788642142.645893:0:7650:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788642142.646130:0:7650:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788642142.646329:0:7650:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788642142.646561:0:7650:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788642142.646825:0:7650:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788642142.648577:0:7650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788642142.887264:0:7650:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788642142.887273:0:7650:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788642142.887309:0:7650:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788642142.887369:0:7650:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.149@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788642142.887388:0:7650:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788642142.887415:0:7650:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788642143.162411:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642144.186381:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642145.211496:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642145.466378:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107364736:0@lo:13: 00000100:00100000:2.0:1788642145.466467:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642145.466712:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107364736 00000100:00100000:0.0:1788642145.466720:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107364736 00000100:00100000:0.0:1788642145.466791:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788642145.466800:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107364736:12345-0@lo:13: 00002000:00000024:0.0:1788642145.466836:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642145.466889:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107364736:12345-0@lo:13: Request processed in 90us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642145.466896:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788642145.466941:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf0e00 x1875527107364736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642145.466958:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107364736:0@lo:13: 00000100:00080000:2.0:1788642145.467030:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788642146.234521:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642147.258491:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642148.044607:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107364992:0@lo:400: 00000100:00100000:3.0:1788642148.044677:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642148.044741:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788642148.044748:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107364864:0@lo:400: 00000100:00100000:3.0:1788642148.044792:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642148.044829:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107365376:0@lo:400: 00000100:00100000:3.0:1788642148.044856:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642148.044881:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107365120:0@lo:400: 00000100:00100000:0.0:1788642148.045539:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107365248:0@lo:400: 00000100:00100000:0.0:1788642148.045581:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642148.045628:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107364992 00000100:00100000:0.0:1788642148.045637:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107364992 00000100:00100000:0.0:1788642148.045693:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107365376 00000100:00100000:0.0:1788642148.045696:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107365376 00000100:00100000:0.0:1788642148.045726:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788642148.045737:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107364992:12345-0@lo:400: 00000100:00100000:0.0:1788642148.045797:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107364992:12345-0@lo:400: Request processed in 62us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642148.045805:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788642148.045824:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788642148.045845:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107365376:12345-0@lo:400: 00000100:00100000:0.0:1788642148.045875:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107365376:12345-0@lo:400: Request processed in 46us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642148.045881:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788642148.046119:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107365248 00000100:00100000:2.0:1788642148.046125:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107365248 00000100:00100000:2.0:1788642148.046168:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788642148.046189:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107365248:12345-0@lo:400: 00000100:00100000:2.0:1788642148.046235:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107365248:12345-0@lo:400: Request processed in 50us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642148.046242:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788642148.047237:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788642148.047435:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788642148.047443:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788642148.047579:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc64f0380 x1875527107365248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642148.047596:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107365248:0@lo:400: 00000100:00100000:0.0:1788642148.047627:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107365120 00000100:00100000:0.0:1788642148.047632:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107365120 00000100:00100000:0.0:1788642148.047676:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788642148.047684:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107365120:12345-0@lo:400: 00000100:00100000:0.0:1788642148.047743:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107365120:12345-0@lo:400: Request processed in 59us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642148.047761:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788642148.053673:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc64f3480 x1875527107365376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642148.053692:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107365376:0@lo:400: 00010000:00080000:0.0:1788642148.053707:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc64f3100 x1875527107364992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642148.053715:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107364992:0@lo:400: 00000100:00080000:0.0:1788642148.053892:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642148.057445:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107364864 00000100:00100000:3.0:1788642148.057462:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107364864 00000100:00100000:3.0:1788642148.057582:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788642148.057592:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:3318:x1875527107364864:12345-0@lo:400: 00000100:00100000:3.0:1788642148.057679:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:3318:x1875527107364864:12345-0@lo:400: Request processed in 89us (12885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642148.057687:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788642148.057727:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107364864:0@lo:400: 00010000:00080000:2.0:1788642148.059141:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc64f0a80 x1875527107365120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642148.059159:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107365120:0@lo:400: 00010000:00010000:0.0:1788642148.285463:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788642149.053161:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788642149.053173:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dddef9be800 from 30 10000000:01000000:2.0:1788642149.053179:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788642149.053255:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642149.053268:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642149.053282:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642149.053322:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107365504:0@lo:101: 00000100:00100000:2.0:1788642149.053427:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642149.053494:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd91f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788642149.054942:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107365504 00000100:00100000:1.0:1788642149.054955:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107365504 00000100:00100000:1.0:1788642149.055164:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788642149.055176:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107365504:12345-0@lo:101: 00010000:00010000:1.0:1788642149.055196:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642149.055241:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddcfb50800/0x4ae1ee156666d0b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d0aa expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642149.055271:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddcfb50800/0x4ae1ee156666d0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d0aa expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642149.055283:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddcfb50800/0x4ae1ee156666d0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d0aa expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642149.055294:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50800, rc 0) 00000100:00100000:1.0:1788642149.055387:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107365504:12345-0@lo:101: Request processed in 213us (1960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642149.055408:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788642149.055508:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107365504:0@lo:101: 00010000:00010000:3.0:1788642149.055532:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0b1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642149.055544:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d0b1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642149.055623:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107365632:0@lo:501: 00000100:00100000:3.0:1788642149.055660:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642149.061557:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.063184:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107365632 00000100:00100000:0.0:1788642149.063217:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107365632 00000100:00100000:0.0:1788642149.063301:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788642149.063312:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107365632:12345-0@lo:501: 00000100:00100000:0.0:1788642149.067499:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107365632:12345-0@lo:501: Request processed in 4182us (11832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.067511:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788642149.067572:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107365632:0@lo:501: 00000100:00100000:0.0:1788642149.069453:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107365760:0@lo:503: 00000100:00100000:0.0:1788642149.069567:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.069624:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd6b1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788642149.071741:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107365760 00000100:00100000:1.0:1788642149.071766:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107365760 00000100:00100000:1.0:1788642149.071829:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788642149.071849:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107365760:12345-0@lo:503: 00000100:00100000:1.0:1788642149.072294:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107365760:12345-0@lo:503: Request processed in 446us (2727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642149.072302:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788642149.072380:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107365760:0@lo:503: 00000100:00100000:1.0:1788642149.072587:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7954:1875527107365888:0@lo:502: 00000100:00100000:1.0:1788642149.072631:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642149.072652:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107365888 00000100:00100000:1.0:1788642149.072656:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107365888 00000100:00100000:1.0:1788642149.072673:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788642149.072679:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7954:x1875527107365888:12345-0@lo:502: 00000100:00100000:1.0:1788642149.072909:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7954:x1875527107365888:12345-0@lo:502: Request processed in 228us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642149.072916:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788642149.072954:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4d66e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642149.072967:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7954:1875527107365888:0@lo:502: 00000100:00100000:1.0:1788642149.073010:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7954:1875527107366016:0@lo:502: 00000100:00100000:1.0:1788642149.073040:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642149.073056:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107366016 00000100:00100000:1.0:1788642149.073059:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107366016 00000100:00100000:1.0:1788642149.073074:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788642149.073086:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7954:x1875527107366016:12345-0@lo:502: 00000100:00100000:1.0:1788642149.073229:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:7954:x1875527107366016:12345-0@lo:502: Request processed in 143us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642149.073237:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788642149.073267:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4d66e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642149.073278:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7954:1875527107366016:0@lo:502: 00000040:00080000:1.0:1788642149.073298:0:7954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788642149.073344:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788642149.073362:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788642149.073373:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0b1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642149.073383:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0b1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642149.073391:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788642149.073394:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788642149.073397:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788642149.073420:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642149.073428:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642149.073438:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642149.073449:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107366144:0@lo:101: 00000100:00100000:1.0:1788642149.073472:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642149.073506:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4d66e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788642149.073953:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107366144 00000100:00100000:2.0:1788642149.073960:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107366144 00000100:00100000:2.0:1788642149.073999:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788642149.074006:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107366144:12345-0@lo:101: 00010000:00010000:2.0:1788642149.074015:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642149.074028:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d0bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d0b8 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642149.074059:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d0bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d0b8 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642149.074068:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d0bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d0b8 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642149.074077:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f8c00, rc 0) 00000100:00100000:2.0:1788642149.074132:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107366144:12345-0@lo:101: Request processed in 127us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642149.074139:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788642149.074173:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107366144:0@lo:101: 00010000:00010000:2.0:1788642149.074186:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642149.074195:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d0bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642149.074458:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107366272:0@lo:501: 00000100:00100000:2.0:1788642149.074487:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642149.074504:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd91f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642149.074516:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107366272 00000100:00100000:2.0:1788642149.074520:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107366272 00000100:00100000:2.0:1788642149.074538:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788642149.074545:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107366272:12345-0@lo:501: 00000100:00100000:2.0:1788642149.074788:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107366272:12345-0@lo:501: Request processed in 242us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642149.074795:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788642149.074834:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107366272:0@lo:501: 00000100:00100000:2.0:1788642149.074859:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107366400:0@lo:503: 00000100:00100000:2.0:1788642149.074896:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642149.074910:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd91f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642149.074922:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107366400 00000100:00100000:2.0:1788642149.074925:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107366400 00000100:00100000:2.0:1788642149.074942:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788642149.074948:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107366400:12345-0@lo:503: 00000100:00100000:2.0:1788642149.079161:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107366400:12345-0@lo:503: Request processed in 4201us (4253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642149.079178:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788642149.079207:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107366400:0@lo:503: 00000100:00100000:0.0:1788642149.083368:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7955:1875527107366528:0@lo:502: 00000100:00100000:0.0:1788642149.083471:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.083538:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd6b1e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788642149.083692:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107366528 00000100:00100000:1.0:1788642149.083702:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107366528 00000100:00100000:1.0:1788642149.083784:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788642149.083794:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:7955:x1875527107366528:12345-0@lo:502: 00000100:00100000:1.0:1788642149.084284:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:7955:x1875527107366528:12345-0@lo:502: Request processed in 490us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642149.084293:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788642149.085259:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7955:1875527107366528:0@lo:502: 00000020:01000000:0.0:1788642149.085302:0:7955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642149.085314:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642149.085326:0:7955:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788642149.085332:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788642149.085334:0:7955:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788642149.085368:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7955:1875527107366656:0@lo:502: 00000100:00100000:0.0:1788642149.085436:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.085478:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd6b1e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788642149.085488:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107366656 00000100:00100000:2.0:1788642149.085495:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107366656 00000100:00100000:2.0:1788642149.085543:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788642149.085553:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:7955:x1875527107366656:12345-0@lo:502: 00000100:00100000:2.0:1788642149.085786:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:7955:x1875527107366656:12345-0@lo:502: Request processed in 233us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642149.085794:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788642149.085882:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7955:1875527107366656:0@lo:502: 00000020:01000000:0.0:1788642149.085904:0:7955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642149.085909:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642149.085911:0:7955:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788642149.085914:0:7955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788642149.086036:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788642149.086056:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788642149.086065:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642149.086076:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788642149.086087:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788642149.086121:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dddc599b800 from 30 10000000:01000000:2.0:1788642149.086124:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788642149.086153:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642149.086161:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642149.086171:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642149.086185:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107366784:0@lo:101: 00000100:00100000:2.0:1788642149.086225:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642149.086248:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd91f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.086408:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107366784 00000100:00100000:0.0:1788642149.086415:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107366784 00000100:00100000:0.0:1788642149.086453:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788642149.086461:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107366784:12345-0@lo:101: 00010000:00010000:0.0:1788642149.086470:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642149.086485:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9832200/0x4ae1ee156666d0cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d0c6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.086510:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9832200/0x4ae1ee156666d0cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d0c6 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.086521:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9832200/0x4ae1ee156666d0cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d0c6 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.086530:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9832200, rc 0) 00000100:00100000:0.0:1788642149.086575:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107366784:12345-0@lo:101: Request processed in 115us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.086581:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788642149.086887:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107366784:0@lo:101: 00010000:00010000:1.0:1788642149.086903:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0cd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642149.086914:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d0cd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642149.086967:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107366912:0@lo:501: 00000100:00100000:1.0:1788642149.086995:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642149.087027:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4d66180 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.087139:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107366912 00000100:00100000:0.0:1788642149.087146:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107366912 00000100:00100000:0.0:1788642149.087175:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788642149.087183:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107366912:12345-0@lo:501: 00000100:00100000:0.0:1788642149.087674:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107366912:12345-0@lo:501: Request processed in 489us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.087682:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788642149.087984:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107366912:0@lo:501: 00000100:00100000:2.0:1788642149.088020:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107367040:0@lo:503: 00000100:00100000:2.0:1788642149.088070:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642149.088126:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd91f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.088945:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107367040 00000100:00100000:0.0:1788642149.088954:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107367040 00000100:00100000:0.0:1788642149.089435:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788642149.089444:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107367040:12345-0@lo:503: 00000100:00100000:0.0:1788642149.089644:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107367040:12345-0@lo:503: Request processed in 201us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.089652:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788642149.089704:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107367040:0@lo:503: 00000100:00100000:1.0:1788642149.093989:0:7956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7956:1875527107367168:0@lo:502: 00000100:00100000:1.0:1788642149.094113:0:7956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642149.094165:0:7956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4d66180 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.094999:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107367168 00000100:00100000:0.0:1788642149.095012:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107367168 00000100:00100000:0.0:1788642149.095087:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788642149.095112:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:7956:x1875527107367168:12345-0@lo:502: 00000100:00100000:0.0:1788642149.096612:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:7956:x1875527107367168:12345-0@lo:502: Request processed in 1509us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.096624:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788642149.096797:0:7956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7956:1875527107367168:0@lo:502: 00000100:00100000:1.0:1788642149.096873:0:7956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7956:1875527107367296:0@lo:502: 00000100:00100000:1.0:1788642149.096920:0:7956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642149.096949:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107367296 00000100:00100000:1.0:1788642149.096955:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107367296 00000100:00100000:1.0:1788642149.096994:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788642149.097014:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:7956:x1875527107367296:12345-0@lo:502: 00000100:00100000:1.0:1788642149.097219:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:7956:x1875527107367296:12345-0@lo:502: Request processed in 212us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642149.103385:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788642149.103507:0:7956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4d66180 going to sleep for 11 seconds 00000100:00100000:1.0:1788642149.103553:0:7956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7956:1875527107367296:0@lo:502: 00000040:00080000:1.0:1788642149.103608:0:7956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788642149.103707:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788642149.103728:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788642149.103747:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0cd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.103760:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0cd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642149.103770:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788642149.103772:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dddc599b800 from 5 10000000:01000000:0.0:1788642149.103776:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788642149.103818:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.103827:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.103837:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642149.103856:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107367424:0@lo:101: 00000100:00100000:0.0:1788642149.103915:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.103942:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc734dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.103960:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107367424 00000100:00100000:0.0:1788642149.103966:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107367424 00000100:00100000:0.0:1788642149.104003:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788642149.104011:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107367424:12345-0@lo:101: 00010000:00010000:0.0:1788642149.104023:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642149.104037:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666d0db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d0d4 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.104060:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666d0db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d0d4 expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.104077:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666d0db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d0d4 expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.104085:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9832e00, rc 0) 00000100:00100000:0.0:1788642149.104138:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107367424:12345-0@lo:101: Request processed in 127us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.104144:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788642149.104177:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107367424:0@lo:101: 00010000:00010000:0.0:1788642149.104189:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.104209:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642149.104251:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107367552:0@lo:256: 00000100:00100000:0.0:1788642149.104282:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.104296:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc734dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.104307:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107367552 00000100:00100000:0.0:1788642149.104310:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107367552 00000100:00100000:0.0:1788642149.104331:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788642149.104338:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107367552:12345-0@lo:256: 20000000:01000000:0.0:1788642149.104350:0:5854:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788642149.104366:0:5854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788642149.104369:0:5854:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788642149.104446:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107367552:12345-0@lo:256: Request processed in 108us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.104453:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788642149.104485:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107367552:0@lo:256: 10000000:01000000:0.0:1788642149.104522:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788642149.104527:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.104534:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642149.104540:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788642149.104542:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788642149.104544:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788642149.104559:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.104566:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.104573:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642149.104583:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107367680:0@lo:101: 00000100:00100000:0.0:1788642149.104609:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.104634:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc734dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.104645:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107367680 00000100:00100000:0.0:1788642149.104649:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107367680 00000100:00100000:0.0:1788642149.104669:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788642149.104675:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107367680:12345-0@lo:101: 00010000:00010000:0.0:1788642149.104682:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642149.104691:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d0e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d0e2 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.104710:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d0e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d0e2 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.104718:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d0e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d0e2 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.104725:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833a00, rc 0) 00000100:00100000:0.0:1788642149.104753:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107367680:12345-0@lo:101: Request processed in 77us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.104759:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788642149.104786:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107367680:0@lo:101: 00010000:00010000:0.0:1788642149.104796:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.104804:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d0e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642149.104845:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107367808:0@lo:501: 00000100:00100000:0.0:1788642149.104868:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.104880:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc734dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.104889:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107367808 00000100:00100000:0.0:1788642149.104893:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107367808 00000100:00100000:0.0:1788642149.104909:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788642149.104914:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107367808:12345-0@lo:501: 00000100:00100000:0.0:1788642149.105194:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107367808:12345-0@lo:501: Request processed in 278us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.105212:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788642149.105247:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107367808:0@lo:501: 00000100:00100000:0.0:1788642149.105273:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107367936:0@lo:503: 00000100:00100000:0.0:1788642149.105307:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.105320:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc734dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.105331:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107367936 00000100:00100000:0.0:1788642149.105335:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107367936 00000100:00100000:0.0:1788642149.105356:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788642149.105363:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107367936:12345-0@lo:503: 00000100:00100000:0.0:1788642149.105665:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107367936:12345-0@lo:503: Request processed in 301us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.105672:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788642149.107049:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107367936:0@lo:503: 00000100:00100000:1.0:1788642149.110531:0:7959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7959:1875527107368064:0@lo:502: 00000100:00100000:1.0:1788642149.110622:0:7959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.110905:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107368064 00000100:00100000:0.0:1788642149.110917:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107368064 00000100:00100000:0.0:1788642149.110984:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788642149.110995:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:7959:x1875527107368064:12345-0@lo:502: 00000100:00100000:1.0:1788642149.111135:0:7959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4d66e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.111416:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:7959:x1875527107368064:12345-0@lo:502: Request processed in 421us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.111424:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788642149.111996:0:7959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7959:1875527107368064:0@lo:502: 00000020:01000000:1.0:1788642149.112035:0:7959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788642149.112044:0:7959:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788642149.112052:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642149.112055:0:7959:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788642149.112059:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788642149.112063:0:7959:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.149@tcp to nid 0x20000c0a8ca95 (192.168.202.149@tcp) 00000020:01000000:1.0:1788642149.112088:0:7959:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788642149.112091:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788642149.112185:0:7959:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dddeff40000) 00000020:00000080:1.0:1788642149.112216:0:7959:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788642149.112225:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788642149.112302:0:7959:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788642149.112308:0:7959:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788642149.115179:0:7959:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666d0f7 00010000:00080000:1.0:1788642149.115264:0:7959:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ddcc533c800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.149@tcp at head 00010000:00010000:1.0:1788642149.115543:0:7959:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788642149.116291:0:7959:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788642149.116318:0:7959:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788642149.117675:0:7959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788642149.117972:0:7959:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788642149.118028:0:7959:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788642149.118091:0:7959:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788642149.118533:0:7960:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788642149.118538:0:7960:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788642149.119126:0:7959:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788642149.119139:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788642149.119172:0:7959:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788642149.119194:0:7959:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4ae1ee156666d0fe 00000100:00080000:0.0:1788642149.119221:0:7959:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788642149.119228:0:7959:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ddcc533c800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:0.0:1788642149.119264:0:7959:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfacf1c00 x1875527107368192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788642149.119293:0:7959:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788642149.119637:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788642149.119653:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107368320:0@lo:400: 00000100:00100000:0.0:1788642149.119661:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788642149.119669:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107368704:0@lo:400: 00000100:00100000:1.0:1788642149.119721:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107368192:0@lo:8: 00000100:00100000:0.0:1788642149.123708:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.123797:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107368576:0@lo:400: 00000100:00100000:0.0:1788642149.123843:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.123878:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788642149.123886:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107368448:0@lo:400: 00000100:00100000:1.0:1788642149.124559:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107368576 00000100:00100000:1.0:1788642149.124569:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107368576 00000100:00100000:0.0:1788642149.124588:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642149.124621:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788642149.124632:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107368576:12345-0@lo:400: 00000100:00100000:0.0:1788642149.124635:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107368704 00000100:00100000:0.0:1788642149.124638:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107368704 00000100:00100000:0.0:1788642149.124666:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107368448 00000100:00100000:0.0:1788642149.124668:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107368448 00000100:00100000:0.0:1788642149.124682:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788642149.124688:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107368704:12345-0@lo:400: 00000100:00100000:1.0:1788642149.124693:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107368576:12345-0@lo:400: Request processed in 62us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642149.124699:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788642149.124723:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107368704:12345-0@lo:400: Request processed in 35us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.124729:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788642149.124741:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788642149.124747:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107368448:12345-0@lo:400: 00010000:00080000:1.0:1788642149.124767:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf1180 x1875527107368576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642149.124773:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107368448:12345-0@lo:400: Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.124778:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788642149.124783:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107368576:0@lo:400: 00010000:00080000:1.0:1788642149.124805:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf0380 x1875527107368448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642149.124815:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107368448:0@lo:400: 00010000:00080000:0.0:1788642149.124818:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf1f80 x1875527107368704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642149.124827:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107368704:0@lo:400: 00000100:00100000:1.0:1788642149.124862:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642149.124880:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107368192 00000100:00100000:1.0:1788642149.124884:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107368192 00000020:01000000:0.0:1788642149.124895:0:7959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1788642149.124900:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000020:00000080:0.0:1788642149.124902:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1788642149.124904:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3316:x1875527107368192:12345-0@lo:8: 00000020:00000080:0.0:1788642149.124905:0:7959:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788642149.124908:0:7959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642149.124912:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642149.124913:0:7959:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788642149.124916:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788642149.124918:0:7959:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00010000:00080000:1.0:1788642149.124931:0:6711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 236 last 0 00000100:00100000:0.0:1788642149.124946:0:7959:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7959:1875527107368832:0@lo:502: 00000020:00000080:1.0:1788642149.124957:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4ae1ee156666d105 00002000:00100000:1.0:1788642149.124971:0:6711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ddcc533a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788642149.124975:0:6711:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788642149.124984:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788642149.124986:0:7959:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.125010:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107368832 00000100:00100000:0.0:1788642149.125013:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107368832 00000100:00100000:0.0:1788642149.125037:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788642149.125042:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:7959:x1875527107368832:12345-0@lo:502: 00002000:00100000:1.0:1788642149.125139:0:6711:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788642149.125633:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:7959:x1875527107368832:12345-0@lo:502: Request processed in 589us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.125641:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788642149.125698:0:7959:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc656f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.125716:0:7959:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:7959:1875527107368832:0@lo:502: 00000020:01000000:0.0:1788642149.125746:0:7959:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642149.125751:0:7959:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642149.125753:0:7959:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788642149.125757:0:7959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00080000:1.0:1788642149.125812:0:6711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788642149.125899:0:6711:0:(import.c:65:import_set_state_nolock()) ffff8dddff6b4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788642149.125935:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1875527107368192:12345-0@lo:8: Request processed in 1030us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642149.125943:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788642149.125979:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf1c00 x1875527107368192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788642159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642149.125988:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788642149.125994:0:3316:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788642149.126002:0:3316:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788642149.126007:0:3316:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788642149.126009:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8ddcc533c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788642149.126033:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788642149.126037:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107368192:0@lo:8: 00000004:00080000:0.0:1788642149.127625:0:7960:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788642149.127802:0:7960:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 236588702140ns, next at 0ns, rc = 0 00000020:01000000:3.0:1788642149.129883:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788642149.129927:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788642149.129939:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642149.129960:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642149.129970:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788642149.129973:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dddc4e04d40 from 1 10000000:01000000:3.0:1788642149.129976:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788642149.130013:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642149.130021:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642149.130032:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642149.130053:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107368960:0@lo:101: 00000100:00100000:2.0:1788642149.130058:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642149.130120:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642149.130144:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107368320 00000100:00100000:3.0:1788642149.130149:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642149.130152:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107368320 00000100:00100000:3.0:1788642149.130166:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107368960 00000100:00100000:3.0:1788642149.130169:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107368960 00000100:00100000:3.0:1788642149.130214:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788642149.130214:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788642149.130223:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107368960:12345-0@lo:101: 00000100:00100000:2.0:1788642149.130223:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107368320:12345-0@lo:400: 00000100:00100000:2.0:1788642149.130278:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107368320:12345-0@lo:400: Request processed in 56us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642149.130285:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788642149.130443:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642149.130458:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d113 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d10c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642149.130482:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d10c expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642149.130506:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d10c expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642149.130516:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6120200, rc 0) 00000100:00100000:3.0:1788642149.130555:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107368960:12345-0@lo:101: Request processed in 334us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642149.130561:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788642149.130654:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107368960:0@lo:101: 00010000:00010000:0.0:1788642149.130680:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d113 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.130689:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d113 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642149.130746:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107369088:0@lo:501: 00000100:00100000:0.0:1788642149.130776:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642149.130791:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc656f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642149.130806:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107369088 00000100:00100000:0.0:1788642149.130809:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107369088 00000100:00100000:0.0:1788642149.130841:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788642149.130848:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107369088:12345-0@lo:501: 00000100:00100000:0.0:1788642149.131060:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107369088:12345-0@lo:501: Request processed in 213us (283us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788642149.131068:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788642149.131113:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107369088:0@lo:501: 10000000:01000000:0.0:1788642149.131134:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788642149.131140:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d113 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642149.131149:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d113 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788642149.135640:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf3480 x1875527107368320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642149.135659:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107368320:0@lo:400: 00000004:00080000:3.0:1788642149.196384:0:7961:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788642149.196420:0:7961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7961:1875527107369344:0@lo:7: 00000100:00100000:3.0:1788642149.196504:0:7961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642149.196563:0:7961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5f3c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788642149.196588:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788642149.196628:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107369216:0@lo:13: 00000100:00100000:3.0:1788642149.196656:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642149.196704:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107369344 00000100:00100000:3.0:1788642149.196713:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107369344 00000100:00100000:3.0:1788642149.197262:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788642149.197274:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7961:x1875527107369344:12345-0@lo:7: 00000100:00100000:2.0:1788642149.203521:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107369216 00000100:00100000:2.0:1788642149.203537:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107369216 00000100:00100000:2.0:1788642149.203612:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788642149.203623:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875527107369216:12345-0@lo:13: 00002000:00000024:2.0:1788642149.203660:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788642149.203759:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875527107369216:12345-0@lo:13: Request processed in 139us (7102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642149.203767:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788642149.203848:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc64f1880 x1875527107369216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642149.203870:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107369216:0@lo:13: 00000100:00080000:0.0:1788642149.205419:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788642149.207730:0:6709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788642149.207739:0:6709:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788642149.208152:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7961:x1875527107369344:12345-0@lo:7: Request processed in 10878us (11643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642149.208165:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788642149.208352:0:7961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc64f2300 x1875527107369344/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788642165 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642149.208368:0:7961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7961:1875527107369344:0@lo:7: 00000004:00080000:2.0:1788642149.208393:0:7961:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788642149.208437:0:7961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7961:1875527107369472:0@lo:5: 00000100:00100000:2.0:1788642149.208476:0:7961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642149.208531:0:7961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642149.209017:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107369472 00000100:00100000:3.0:1788642149.209024:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107369472 00000100:00100000:3.0:1788642149.209074:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788642149.209083:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7961:x1875527107369472:12345-0@lo:5: 00002000:00080000:3.0:1788642149.209150:0:6712:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788642149.209154:0:6712:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788642149.209481:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7961:x1875527107369472:12345-0@lo:5: Request processed in 398us (1003us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788642149.209489:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788642149.209941:0:7961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef17c000 x1875527107369472/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788642165 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642149.209957:0:7961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7961:1875527107369472:0@lo:5: 00000004:00080000:2.0:1788642149.209967:0:7961:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788642149.210011:0:7961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7961:1875527107369600:0@lo:700: 00000100:00100000:2.0:1788642149.210043:0:7961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642149.210075:0:7961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642149.210188:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107369600 00000100:00100000:3.0:1788642149.210204:0:6718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107369600 00000100:00100000:3.0:1788642149.210242:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788642149.210250:0:6718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7961:x1875527107369600:12345-0@lo:700: 00000100:00100000:3.0:1788642149.210280:0:6718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6718:1875527107369728:0@lo:700: 00000100:00100000:3.0:1788642149.210321:0:6718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642149.210350:0:6718:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788642149.210363:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107369728 00000100:00100000:3.0:1788642149.210368:0:5868:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107369728 00000100:00100000:3.0:1788642149.210397:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788642149.210404:0:5868:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6718:x1875527107369728:12345-0@lo:700: 40000000:02000000:3.0:1788642149.264197:0:5868:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788642149.271494:0:5868:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6718:x1875527107369728:12345-0@lo:700: Request processed in 61079us (61160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642149.271511:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788642149.271849:0:6718:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc64f3100 x1875527107369728/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788642165 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642149.271865:0:6718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6718:1875527107369728:0@lo:700: 40000000:02000000:1.0:1788642149.271880:0:6718:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:0.0:1788642149.316118:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788642149.409464:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788642149.409484:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1788642149.413290:0:6718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7961:x1875527107369600:12345-0@lo:700: Request processed in 203028us (203232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642149.413320:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788642149.413398:0:7961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef17df80 x1875527107369600/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788642165 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642149.413413:0:7961:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788642149.413435:0:7961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7961:1875527107369600:0@lo:700: 00000004:02000040:3.0:1788642149.472456:0:7961:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788642149.476973:0:7961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7961:1875527107369856:0@lo:5: 00000100:00100000:2.0:1788642149.477038:0:7961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642149.477137:0:7961:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788642149.477325:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107369856 00000100:00100000:3.0:1788642149.477341:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107369856 00000100:00100000:3.0:1788642149.477399:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788642149.477409:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7961:x1875527107369856:12345-0@lo:5: 00002000:00080000:3.0:1788642149.486005:0:6709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788642149.486028:0:6709:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788642149.499558:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7961:x1875527107369856:12345-0@lo:5: Request processed in 22138us (22507us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788642149.499573:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788642149.499979:0:7961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef17df80 x1875527107369856/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788642165 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642149.500002:0:7961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7961:1875527107369856:0@lo:5: 00000004:00080000:2.0:1788642149.500020:0:7961:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:0.0:1788642150.039424:0:8018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788642150.334128:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642150.586412:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107369984:0@lo:13: 00000100:00100000:2.0:1788642150.586558:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642150.586708:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107369984 00000100:00100000:0.0:1788642150.586720:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107369984 00000100:00100000:0.0:1788642150.586801:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788642150.586813:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107369984:12345-0@lo:13: 00002000:00000024:0.0:1788642150.586860:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642150.586915:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107369984:12345-0@lo:13: Request processed in 105us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642150.586923:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788642150.587208:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788642150.587250:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf1f80 x1875527107369984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642150.587272:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107369984:0@lo:13: 00010000:00010000:0.0:1788642151.356512:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642152.384641:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642153.405673:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642154.172023:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107370496:0@lo:400: 00000100:00100000:3.0:1788642154.172171:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642154.172251:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788642154.172259:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107370112:0@lo:400: 00000100:00100000:3.0:1788642154.172294:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642154.172319:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107370624:0@lo:400: 00000100:00100000:3.0:1788642154.172346:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642154.172704:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107370368:0@lo:400: 00000100:00100000:3.0:1788642154.172738:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642154.172777:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788642154.172784:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107370240:0@lo:400: 00000100:00100000:3.0:1788642154.172808:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642154.172825:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107370752:0@lo:400: 00000100:00100000:3.0:1788642154.172911:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642154.172950:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107370112 00000100:00100000:3.0:1788642154.172962:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107370112 00000100:00100000:3.0:1788642154.173021:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788642154.173033:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3319:x1875527107370112:12345-0@lo:400: 00000100:00100000:3.0:1788642154.173409:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3319:x1875527107370112:12345-0@lo:400: Request processed in 377us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642154.173417:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788642154.173460:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107370624 00000100:00100000:3.0:1788642154.173464:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107370624 00000100:00100000:3.0:1788642154.173502:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107370368 00000100:00100000:3.0:1788642154.173506:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107370368 00000100:00100000:3.0:1788642154.173520:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107370240 00000100:00100000:3.0:1788642154.173524:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107370240 00000100:00100000:3.0:1788642154.173537:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788642154.173543:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107370624:12345-0@lo:400: 00000100:00100000:3.0:1788642154.173578:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107370624:12345-0@lo:400: Request processed in 35us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642154.173585:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788642154.173597:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788642154.173603:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107370368:12345-0@lo:400: 00000100:00100000:3.0:1788642154.173635:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107370368:12345-0@lo:400: Request processed in 32us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642154.173640:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788642154.173651:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788642154.173657:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107370240:12345-0@lo:400: 00000100:00100000:3.0:1788642154.173685:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107370240:12345-0@lo:400: Request processed in 29us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642154.173692:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788642154.173718:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107370496 00000100:00100000:3.0:1788642154.173722:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107370496 00000100:00100000:3.0:1788642154.173758:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107370752 00000100:00100000:3.0:1788642154.173770:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107370752 00000100:00100000:3.0:1788642154.173789:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788642154.173795:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107370496:12345-0@lo:400: 00000100:00100000:3.0:1788642154.173827:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107370496:12345-0@lo:400: Request processed in 33us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642154.173845:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788642154.173856:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788642154.173861:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875527107370752:12345-0@lo:400: 00000100:00100000:3.0:1788642154.173889:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875527107370752:12345-0@lo:400: Request processed in 28us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642154.173895:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788642154.173912:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788642154.173918:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788642154.173921:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788642154.173960:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc64f3100 x1875527107370240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642154.173979:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107370240:0@lo:400: 00010000:00080000:3.0:1788642154.173994:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc4e37100 x1875527107370752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642154.174003:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107370752:0@lo:400: 00010000:00080000:3.0:1788642154.174013:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc64f2300 x1875527107370368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642154.174021:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107370368:0@lo:400: 00000100:00100000:1.0:1788642154.182093:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107370112:0@lo:400: 00010000:00080000:1.0:1788642154.182149:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc4e35180 x1875527107370624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642154.182165:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107370624:0@lo:400: 00010000:00080000:1.0:1788642154.182182:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc64f1880 x1875527107370496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642154.182218:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107370496:0@lo:400: 00010000:00010000:0.0:1788642154.426948:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642154.682602:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107370880:0@lo:13: 00000100:00100000:1.0:1788642154.682853:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642154.683134:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107370880 00000100:00100000:2.0:1788642154.683145:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107370880 00000100:00100000:2.0:1788642154.687567:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788642154.687598:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875527107370880:12345-0@lo:13: 00002000:00000024:2.0:1788642154.687658:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642154.687818:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875527107370880:12345-0@lo:13: Request processed in 233us (4964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642154.687828:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788642154.692486:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef150380 x1875527107370880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642154.692538:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107370880:0@lo:13: 00000001:00080000:0.0:1788642154.881876:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788642155.463277:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642155.708599:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788642155.708627:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107371008:0@lo:13: 00000100:00100000:1.0:1788642155.708700:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642155.708774:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107371008 00000100:00100000:1.0:1788642155.708781:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107371008 00000100:00100000:1.0:1788642155.708825:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788642155.708834:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107371008:12345-0@lo:13: 00002000:00000024:1.0:1788642155.708868:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642155.708913:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef152300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107371008:12345-0@lo:13: Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642155.708920:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788642155.708960:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef150380 x1875527107371008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642155.708978:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107371008:0@lo:13: 00010000:00010000:2.0:1788642156.475323:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642157.270288:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642157.273644:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086375040 00000100:00100000:0.0:1788642157.273662:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086375040 00000100:00100000:0.0:1788642157.273738:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 112 00000100:00100000:0.0:1788642157.273749:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2358:x1875527086375040:12345-192.168.202.49@tcp:250: 00010000:00080000:0.0:1788642157.273789:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9684ea0b-8125-4caf-b771-9063c6354463@192.168.202.49@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:0.0:1788642157.273829:0:5854:0:(genops.c:1385:class_connect()) connect: client 9684ea0b-8125-4caf-b771-9063c6354463, cookie 0x4ae1ee156666d11a 00000100:00080000:1.0:1788642157.276077:0:5854:0:(import.c:65:import_set_state_nolock()) ffff8dddef7ff800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788642157.276198:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+5:2358:x1875527086375040:12345-192.168.202.49@tcp:250: Request processed in 2443us (5914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642157.276220:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 112 00000100:00100000:1.0:1788642157.297229:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642157.297331:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086375168 00000100:00100000:3.0:1788642157.297340:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086375168 00000100:00100000:3.0:1788642157.297406:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 113 00000100:00100000:3.0:1788642157.297416:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+5:5601:x1875527086375168:12345-192.168.202.49@tcp:101: 00010000:00010000:3.0:1788642157.297433:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642157.297450:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d121 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a964a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642157.297478:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a964a expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642157.297491:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a964a expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642157.297501:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6120400, rc 0) 00000100:00100000:3.0:1788642157.297555:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+6:5601:x1875527086375168:12345-192.168.202.49@tcp:101: Request processed in 140us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642157.297563:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 113 00000100:00100000:1.0:1788642157.308441:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642157.308625:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086375296 00000100:00100000:0.0:1788642157.308637:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086375296 00000100:00100000:0.0:1788642157.308847:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 114 00000100:00100000:0.0:1788642157.308860:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+6:5601:x1875527086375296:12345-192.168.202.49@tcp:501: 00000100:00100000:0.0:1788642157.309246:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+6:5601:x1875527086375296:12345-192.168.202.49@tcp:501: Request processed in 388us (813us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788642157.309255:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 114 00000100:00100000:3.0:1788642157.318888:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642157.318947:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086375424 00000100:00100000:1.0:1788642157.318966:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086375424 00000100:00100000:1.0:1788642157.319047:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 115 00000100:00100000:1.0:1788642157.319070:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+6:5601:x1875527086375424:12345-192.168.202.49@tcp:101: 00010000:00010000:1.0:1788642157.319130:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642157.319159:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666d128 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9651 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642157.320744:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666d128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9651 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642157.320771:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666d128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9651 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642157.320785:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50a00, rc 0) 00000100:00100000:1.0:1788642157.321000:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+7:5601:x1875527086375424:12345-192.168.202.49@tcp:101: Request processed in 1939us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642157.321286:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 115 00000100:00100000:1.0:1788642157.327783:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642157.328178:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086375552 00000100:00100000:0.0:1788642157.328194:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086375552 00000100:00100000:0.0:1788642157.328260:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 116 00000100:00100000:0.0:1788642157.328270:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+7:5601:x1875527086375552:12345-192.168.202.49@tcp:501: 00000100:00100000:0.0:1788642157.328956:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+8:5601:x1875527086375552:12345-192.168.202.49@tcp:501: Request processed in 684us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642157.328965:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 116 00000100:00100000:1.0:1788642157.337493:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642157.338459:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086375680 00000100:00100000:3.0:1788642157.338477:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086375680 00000100:00100000:3.0:1788642157.338549:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 117 00000100:00100000:3.0:1788642157.338560:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+8:5601:x1875527086375680:12345-192.168.202.49@tcp:503: 00000100:00100000:3.0:1788642157.338961:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+8:5601:x1875527086375680:12345-192.168.202.49@tcp:503: Request processed in 401us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642157.338970:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 117 00000100:00100000:1.0:1788642157.344595:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642157.347810:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086375808 00000100:00100000:0.0:1788642157.347829:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086375808 00000100:00100000:0.0:1788642157.347885:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 118 00000100:00100000:0.0:1788642157.347896:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+8:5620:x1875527086375808:12345-192.168.202.49@tcp:502: 00000100:00100000:0.0:1788642157.348269:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+8:5620:x1875527086375808:12345-192.168.202.49@tcp:502: Request processed in 373us (3684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642157.348278:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 118 00000100:00100000:1.0:1788642157.381950:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642157.382299:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086375936 00000100:00100000:3.0:1788642157.382311:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086375936 00000100:00100000:3.0:1788642157.382372:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 119 00000100:00100000:3.0:1788642157.382383:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+8:5620:x1875527086375936:12345-192.168.202.49@tcp:502: 00000100:00100000:3.0:1788642157.382674:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+8:5620:x1875527086375936:12345-192.168.202.49@tcp:502: Request processed in 292us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642157.382683:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 119 00000100:00100000:2.0:1788642157.410188:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642157.412514:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086376064 00000100:00100000:0.0:1788642157.412528:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086376064 00000100:00100000:0.0:1788642157.412609:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:0.0:1788642157.412622:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+8:5601:x1875527086376064:12345-192.168.202.49@tcp:101: 00010000:00010000:0.0:1788642157.412641:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642157.412666:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9832600/0x4ae1ee156666d12f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a967b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642157.412700:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9832600/0x4ae1ee156666d12f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a967b expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642157.412714:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9832600/0x4ae1ee156666d12f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a967b expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642157.412745:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9832600, rc 0) 00000100:00100000:0.0:1788642157.412821:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+9:5601:x1875527086376064:12345-192.168.202.49@tcp:101: Request processed in 201us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642157.412829:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:1.0:1788642157.422919:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642157.423041:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086376192 00000100:00100000:2.0:1788642157.423053:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086376192 00000100:00100000:2.0:1788642157.423133:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 121 00000100:00100000:2.0:1788642157.423143:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+9:5601:x1875527086376192:12345-192.168.202.49@tcp:256: 20000000:01000000:2.0:1788642157.423170:0:5853:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788642157.423195:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788642157.423199:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788642157.423202:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788642157.423205:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788642157.425843:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+9:5601:x1875527086376192:12345-192.168.202.49@tcp:256: Request processed in 2690us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642157.425858:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 121 00000100:00100000:2.0:1788642157.436624:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642157.437143:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086376320 00000100:00100000:3.0:1788642157.437156:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086376320 00000100:00100000:3.0:1788642157.437216:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 122 00000100:00100000:3.0:1788642157.437225:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+9:5601:x1875527086376320:12345-192.168.202.49@tcp:101: 00010000:00010000:3.0:1788642157.437243:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642157.437263:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d136 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9682 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642157.437295:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9682 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642157.437308:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9682 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642157.437318:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121200, rc 0) 00000100:00100000:3.0:1788642157.437393:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:5601:x1875527086376320:12345-192.168.202.49@tcp:101: Request processed in 169us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642157.437400:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 122 00000100:00100000:3.0:1788642157.439663:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642157.439693:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086376448 00000100:00100000:3.0:1788642157.439702:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086376448 00000100:00100000:3.0:1788642157.439744:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 123 00000100:00100000:3.0:1788642157.439754:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+10:5601:x1875527086376448:12345-192.168.202.49@tcp:501: 00000100:00100000:3.0:1788642157.440066:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+10:5601:x1875527086376448:12345-192.168.202.49@tcp:501: Request processed in 311us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642157.440081:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 123 00000100:00100000:1.0:1788642157.445430:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642157.445531:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086376576 00000100:00100000:0.0:1788642157.445544:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086376576 00000100:00100000:0.0:1788642157.445599:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 124 00000100:00100000:0.0:1788642157.445611:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:5601:x1875527086376576:12345-192.168.202.49@tcp:503: 00000100:00100000:0.0:1788642157.447199:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:5601:x1875527086376576:12345-192.168.202.49@tcp:503: Request processed in 1577us (2086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642157.447216:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 124 00000100:00100000:3.0:1788642157.465751:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642157.473053:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086376704 00000100:00100000:2.0:1788642157.473072:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086376704 00000100:00100000:2.0:1788642157.473163:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 125 00000100:00100000:2.0:1788642157.473174:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+10:5624:x1875527086376704:12345-192.168.202.49@tcp:502: 00000100:00100000:2.0:1788642157.473496:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+10:5624:x1875527086376704:12345-192.168.202.49@tcp:502: Request processed in 323us (7756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642157.473506:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 125 00000100:00100000:2.0:1788642157.480178:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642157.480329:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086376832 00000100:00100000:3.0:1788642157.480340:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086376832 00000100:00100000:3.0:1788642157.480393:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 126 00000100:00100000:3.0:1788642157.480403:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:5624:x1875527086376832:12345-192.168.202.49@tcp:502: 00000100:00100000:3.0:1788642157.480643:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:5624:x1875527086376832:12345-192.168.202.49@tcp:502: Request processed in 239us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642157.480651:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 126 00000100:00100000:2.0:1788642157.485721:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642157.485852:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086376960 00000100:00100000:3.0:1788642157.485863:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086376960 00000100:00100000:3.0:1788642157.485920:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:3.0:1788642157.485938:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1875527086376960:12345-192.168.202.49@tcp:38: 00010000:00080000:3.0:1788642157.485969:0:5863:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:3.0:1788642157.486024:0:5863:0:(genops.c:1385:class_connect()) connect: client e32b659c-dd8d-40c5-94b4-b9b0e719a356, cookie 0x4ae1ee156666d13d 00000004:00100000:3.0:1788642157.486364:0:5863:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788642157.486373:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788642157.498415:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788642157.546429:0:5863:0:(import.c:65:import_set_state_nolock()) ffff8dddeff07800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788642157.546538:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2358:x1875527086376960:12345-192.168.202.49@tcp:38: Request processed in 60607us (60828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642157.546550:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00010000:00010000:3.0:1788642158.525277:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642158.559667:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642158.559706:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642158.559794:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086377088 00000100:00100000:2.0:1788642158.559804:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086377088 00000100:00100000:2.0:1788642158.559899:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086377216 00000100:00100000:2.0:1788642158.559902:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086377216 00000100:00100000:2.0:1788642158.559919:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:2.0:1788642158.559928:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:0:x1875527086377088:12345-192.168.202.49@tcp:41: 00000004:00000024:2.0:1788642158.559984:0:5862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788642158.560071:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:0:x1875527086377088:12345-192.168.202.49@tcp:41: Request processed in 143us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642158.560079:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:2.0:1788642158.560121:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:2.0:1788642158.560129:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:5601:x1875527086377216:12345-192.168.202.49@tcp:41: 00000004:00000024:2.0:1788642158.560140:0:5862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788642158.560161:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:5601:x1875527086377216:12345-192.168.202.49@tcp:41: Request processed in 33us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642158.560168:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00080000:0.0:1788642158.560301:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642158.564592:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642158.564919:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086377344 00000100:00100000:1.0:1788642158.564930:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086377344 00000100:00100000:1.0:1788642158.567356:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:1.0:1788642158.567376:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:5601:x1875527086377344:12345-192.168.202.49@tcp:40: 00000100:00100000:1.0:1788642158.567489:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:5601:x1875527086377344:12345-192.168.202.49@tcp:40: Request processed in 121us (2910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642158.567496:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:1.0:1788642158.574662:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642158.574708:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642158.574750:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642158.574753:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086377472 00000100:00100000:3.0:1788642158.574766:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086377472 00000100:00100000:3.0:1788642158.574800:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086377600 00000100:00100000:3.0:1788642158.574803:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086377600 00000100:00100000:3.0:1788642158.574817:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:3.0:1788642158.574836:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875527086377472:12345-192.168.202.49@tcp:8: 00010000:00080000:3.0:1788642158.574871:0:6712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:3.0:1788642158.574903:0:6712:0:(genops.c:1385:class_connect()) connect: client e32b659c-dd8d-40c5-94b4-b9b0e719a356, cookie 0x4ae1ee156666d144 00002000:00100000:3.0:1788642158.574929:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e32b659c-dd8d-40c5-94b4-b9b0e719a356/ffff8ddcc65cb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788642158.574952:0:6712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788642158.575142:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086377728 00000100:00100000:2.0:1788642158.575148:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086377728 00000100:00100000:2.0:1788642158.575193:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:2.0:1788642158.575201:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:5601:x1875527086377728:12345-192.168.202.49@tcp:33: 00002000:00080000:3.0:1788642158.575339:0:6712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788642158.575369:0:6712:0:(import.c:65:import_set_state_nolock()) ffff8ddcc65cd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788642158.575429:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2358:x1875527086377472:12345-192.168.202.49@tcp:8: Request processed in 603us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642158.578395:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642158.578505:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086377856 00000100:00100000:0.0:1788642158.578514:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086377856 00000100:00100000:0.0:1788642158.578572:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 127 00000100:00100000:0.0:1788642158.578583:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086377856:12345-192.168.202.49@tcp:400: 00000100:00100000:0.0:1788642158.578665:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086377856:12345-192.168.202.49@tcp:400: Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642158.578673:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 127 00000100:00100000:3.0:1788642158.583182:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:3.0:1788642158.583224:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:3.0:1788642158.583233:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875527086377600:12345-192.168.202.49@tcp:8: 00010000:00080000:3.0:1788642158.583269:0:6712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:3.0:1788642158.583299:0:6712:0:(genops.c:1385:class_connect()) connect: client e32b659c-dd8d-40c5-94b4-b9b0e719a356, cookie 0x4ae1ee156666d14b 00002000:00100000:3.0:1788642158.583313:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e32b659c-dd8d-40c5-94b4-b9b0e719a356/ffff8ddcc65c9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788642158.583333:0:6712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788642158.584024:0:6712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788642158.584065:0:6712:0:(import.c:65:import_set_state_nolock()) ffff8ddcc65cf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788642158.584166:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2358:x1875527086377600:12345-192.168.202.49@tcp:8: Request processed in 932us (9456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642158.584174:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000004:00080000:3.0:1788642158.600259:0:5864:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 24998us 00000004:00200000:1.0:1788642158.609779:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788642158.609911:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:5601:x1875527086377728:12345-192.168.202.49@tcp:33: Request processed in 34705us (35154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642158.609925:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:0.0:1788642158.820119:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642158.820305:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086377984 00000100:00100000:3.0:1788642158.820316:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086377984 00000100:00100000:3.0:1788642158.820381:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:3.0:1788642158.820391:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:5642:x1875527086377984:12345-192.168.202.49@tcp:101: 00010000:00010000:3.0:1788642158.820413:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642158.820489:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121000/0x4ae1ee156666d152 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a96ac expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642158.820560:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d159 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642158.820571:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d159 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642158.820582:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d159 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642158.820609:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788642158.820612:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642158.820625:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d159 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642158.820644:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121000/0x4ae1ee156666d152 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96ac expref: 8 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642158.820658:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d159 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96ac expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642158.820664:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde02b5900) 00010000:00010000:3.0:1788642158.820666:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788642158.820670:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121a00, rc 0) 00000100:00100000:3.0:1788642158.820743:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:5642:x1875527086377984:12345-192.168.202.49@tcp:101: Request processed in 353us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642158.820750:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:2.0:1788642159.290465:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107371264:0@lo:400: 00000100:00100000:2.0:1788642159.290557:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642159.290631:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107371776:0@lo:400: 00000100:00100000:2.0:1788642159.290691:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642159.290726:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788642159.290733:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107371392:0@lo:400: 00000100:00100000:2.0:1788642159.290757:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642159.290795:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107371776 00000100:00100000:2.0:1788642159.290803:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107371776 00000100:00100000:2.0:1788642159.290856:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788642159.290866:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107371776:12345-0@lo:400: 00000100:00100000:2.0:1788642159.290919:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107371776:12345-0@lo:400: Request processed in 54us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642159.290927:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788642159.290946:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788642159.290973:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef9ef800 x1875527107371776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642159.290984:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788642159.291000:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107371776:0@lo:400: 00000100:00100000:2.0:1788642159.291019:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107371264 00000100:00100000:2.0:1788642159.291022:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107371264 00000100:00100000:2.0:1788642159.291048:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107371392 00000100:00100000:2.0:1788642159.291050:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107371392 00000100:00100000:2.0:1788642159.291068:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788642159.291075:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107371264:12345-0@lo:400: 00000100:00100000:2.0:1788642159.291138:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107371264:12345-0@lo:400: Request processed in 63us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642159.291144:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788642159.291156:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788642159.291162:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107371392:12345-0@lo:400: 00000100:00100000:2.0:1788642159.291198:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107371392:12345-0@lo:400: Request processed in 37us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642159.291204:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788642159.291223:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642159.291244:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107371392:0@lo:400: 00000100:00100000:2.0:1788642159.291254:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107371264:0@lo:400: 00000100:00100000:0.0:1788642159.291396:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107371520:0@lo:400: 00000100:00100000:0.0:1788642159.291427:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642159.291460:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788642159.291466:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107371136:0@lo:400: 00000100:00100000:0.0:1788642159.291495:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642159.291531:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107371648:0@lo:400: 00000100:00100000:0.0:1788642159.291552:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642159.291841:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107371648 00000100:00100000:3.0:1788642159.291855:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107371648 00000100:00100000:3.0:1788642159.291904:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788642159.291911:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107371648:12345-0@lo:400: 00000100:00100000:3.0:1788642159.291952:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107371648:12345-0@lo:400: Request processed in 42us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642159.291958:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788642159.291987:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107371648:0@lo:400: 00000100:00080000:0.0:1788642159.292044:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642159.292327:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107371520 00000100:00100000:1.0:1788642159.292332:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107371520 00000100:00100000:1.0:1788642159.292384:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788642159.292392:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107371520:12345-0@lo:400: 00000100:00100000:1.0:1788642159.292432:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107371520:12345-0@lo:400: Request processed in 42us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642159.292438:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788642159.292504:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788642159.293772:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107371136 00000100:00100000:2.0:1788642159.293783:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107371136 00000100:00100000:2.0:1788642159.293846:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788642159.293856:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3319:x1875527107371136:12345-0@lo:400: 00000100:00100000:2.0:1788642159.293936:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3319:x1875527107371136:12345-0@lo:400: Request processed in 83us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642159.293942:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788642159.294124:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107371136:0@lo:400: 00010000:00080000:3.0:1788642159.294156:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef9eca80 x1875527107371520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642159.294169:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107371520:0@lo:400: 00010000:00010000:2.0:1788642159.546443:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642159.802399:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107371904:0@lo:13: 00000100:00100000:3.0:1788642159.802485:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642159.802812:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107371904 00000100:00100000:1.0:1788642159.802822:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107371904 00000100:00100000:1.0:1788642159.802878:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788642159.802888:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107371904:12345-0@lo:13: 00002000:00000024:1.0:1788642159.802910:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642159.802957:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107371904:12345-0@lo:13: Request processed in 70us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642159.802977:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788642159.803063:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef150e00 x1875527107371904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642159.803081:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107371904:0@lo:13: 00010000:00010000:0.0:1788642160.573295:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642160.826481:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788642160.826511:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107372032:0@lo:13: 00000100:00100000:1.0:1788642160.826586:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642160.826825:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107372032 00000100:00100000:2.0:1788642160.826833:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107372032 00000100:00100000:2.0:1788642160.826922:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788642160.826932:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107372032:12345-0@lo:13: 00002000:00000024:2.0:1788642160.826970:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642160.827026:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107372032:12345-0@lo:13: Request processed in 95us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642160.827034:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788642160.827145:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf1180 x1875527107372032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642160.827165:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107372032:0@lo:13: 00000100:00100000:2.0:1788642161.168686:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642161.177067:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086378112 00000100:00100000:3.0:1788642161.177123:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086378112 00000100:00100000:3.0:1788642161.177238:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:3.0:1788642161.177250:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:5694:x1875527086378112:12345-192.168.202.49@tcp:41: 00000004:00000024:3.0:1788642161.177303:0:5861:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788642161.177396:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:5694:x1875527086378112:12345-192.168.202.49@tcp:41: Request processed in 149us (8722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642161.177403:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00080000:0.0:1788642161.177674:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642161.183219:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642161.183390:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086378240 00000100:00100000:2.0:1788642161.183401:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086378240 00000100:00100000:2.0:1788642161.183487:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:2.0:1788642161.183498:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:5694:x1875527086378240:12345-192.168.202.49@tcp:13: 00002000:00000024:2.0:1788642161.183537:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642161.183620:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:5694:x1875527086378240:12345-192.168.202.49@tcp:13: Request processed in 124us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642161.183627:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00080000:0.0:1788642161.184170:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642161.191577:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642161.192224:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086378368 00000100:00100000:2.0:1788642161.192251:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086378368 00000100:00100000:2.0:1788642161.192345:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:2.0:1788642161.192356:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:5694:x1875527086378368:12345-192.168.202.49@tcp:13: 00002000:00000024:2.0:1788642161.192393:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642161.192488:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:5694:x1875527086378368:12345-192.168.202.49@tcp:13: Request processed in 134us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642161.192496:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00080000:0.0:1788642161.193023:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788642161.594708:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788642162.475876:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e32b659c-dd8d-40c5-94b4-b9b0e719a356 00010000:00010000:3.0:1788642162.624656:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788642162.968539:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000001:00100000:1.0:1788642162.982841:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e32b659c-dd8d-40c5-94b4-b9b0e719a356 00010000:00010000:0.0:1788642163.662938:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642163.872767:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642163.872862:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642163.872901:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642163.873185:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086378624 00000100:00100000:0.0:1788642163.873201:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086378624 00000100:00100000:0.0:1788642163.873310:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:0.0:1788642163.873324:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086378624:12345-192.168.202.49@tcp:400: 00000100:00100000:0.0:1788642163.873430:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086378624:12345-192.168.202.49@tcp:400: Request processed in 110us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642163.873440:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00080000:0.0:1788642163.873466:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642163.873615:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086378752 00000100:00100000:1.0:1788642163.873620:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086378752 00000100:00100000:1.0:1788642163.873673:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:1.0:1788642163.873693:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086378752:12345-192.168.202.49@tcp:400: 00000100:00100000:1.0:1788642163.873728:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086378752:12345-192.168.202.49@tcp:400: Request processed in 37us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642163.873734:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00080000:0.0:1788642163.874423:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642163.874541:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642163.874626:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086378880 00000100:00100000:2.0:1788642163.874633:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086378880 00000100:00100000:2.0:1788642163.874694:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:2.0:1788642163.874704:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086378880:12345-192.168.202.49@tcp:400: 00000100:00100000:2.0:1788642163.874761:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086378880:12345-192.168.202.49@tcp:400: Request processed in 59us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642163.874769:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00080000:0.0:1788642163.875201:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788642163.875354:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086378496 00000100:00100000:3.0:1788642163.875361:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086378496 00000100:00100000:1.0:1788642163.875640:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 129 00000100:00100000:1.0:1788642163.875649:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:2362:x1875527086378496:12345-192.168.202.49@tcp:400: 00000100:00100000:1.0:1788642163.875910:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:2362:x1875527086378496:12345-192.168.202.49@tcp:400: Request processed in 259us (3158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642163.875917:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 129 00000001:02000400:2.0:1788642164.215713:0:8324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788642164.413052:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107372288:0@lo:400: 00000100:00100000:3.0:1788642164.413145:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642164.413211:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107372800:0@lo:400: 00000100:00100000:3.0:1788642164.413239:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642164.413275:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788642164.413292:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107372416:0@lo:400: 00000100:00100000:3.0:1788642164.413331:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642164.413369:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107372288 00000100:00100000:3.0:1788642164.413377:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107372288 00000100:00100000:3.0:1788642164.413418:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107372416 00000100:00100000:3.0:1788642164.413421:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107372416 00000100:00100000:3.0:1788642164.413446:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788642164.413454:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107372288:12345-0@lo:400: 00000100:00100000:3.0:1788642164.413503:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107372288:12345-0@lo:400: Request processed in 48us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642164.413509:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788642164.413528:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788642164.413534:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107372416:12345-0@lo:400: 00000100:00100000:3.0:1788642164.413560:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107372416:12345-0@lo:400: Request processed in 27us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642164.413565:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788642164.413583:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107372800 00000100:00100000:3.0:1788642164.413586:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107372800 00000100:00100000:3.0:1788642164.413614:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788642164.413627:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107372800:12345-0@lo:400: 00000100:00100000:3.0:1788642164.413657:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107372800:12345-0@lo:400: Request processed in 32us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642164.413663:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788642164.413686:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788642164.413690:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642164.413763:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107372416:0@lo:400: 00000100:00100000:3.0:1788642164.413773:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107372288:0@lo:400: 00010000:00080000:3.0:1788642164.413783:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc64f0380 x1875527107372800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642164.413792:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107372800:0@lo:400: 00000100:00100000:1.0:1788642164.414088:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107372160:0@lo:400: 00000100:00100000:1.0:1788642164.414150:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642164.414200:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1875527107372672:0@lo:400: 00000100:00100000:1.0:1788642164.414225:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642164.414244:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788642164.414249:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107372544:0@lo:400: 00000100:00100000:1.0:1788642164.414279:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642164.414320:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107372544 00000100:00100000:1.0:1788642164.414325:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107372544 00000100:00100000:1.0:1788642164.414355:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788642164.414362:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107372544:12345-0@lo:400: 00000100:00100000:1.0:1788642164.414398:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107372544:12345-0@lo:400: Request processed in 36us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642164.414404:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788642164.414429:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc4e35180 x1875527107372544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642164.414440:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107372544:0@lo:400: 00000100:00100000:3.0:1788642164.414663:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107372160 00000100:00100000:3.0:1788642164.414667:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107372160 00000100:00100000:3.0:1788642164.414700:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788642164.414708:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3320:x1875527107372160:12345-0@lo:400: 00000100:00100000:3.0:1788642164.414751:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3320:x1875527107372160:12345-0@lo:400: Request processed in 44us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642164.414758:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788642164.414782:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642164.414794:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107372672 00000100:00100000:3.0:1788642164.414798:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107372672 00000100:00100000:3.0:1788642164.414826:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788642164.414832:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875527107372672:12345-0@lo:400: 00000100:00100000:3.0:1788642164.414860:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875527107372672:12345-0@lo:400: Request processed in 29us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642164.414869:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788642164.414894:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642164.416259:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107372160:0@lo:400: 00000100:00100000:1.0:1788642164.416303:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1875527107372672:0@lo:400: 00010000:00010000:3.0:1788642164.671387:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642164.923722:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788642164.923748:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107372928:0@lo:13: 00000100:00100000:0.0:1788642164.923834:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642164.924057:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107372928 00000100:00100000:1.0:1788642164.924075:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107372928 00000100:00100000:1.0:1788642164.924160:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788642164.924172:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107372928:12345-0@lo:13: 00002000:00000024:1.0:1788642164.924213:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642164.924266:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107372928:12345-0@lo:13: Request processed in 96us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642164.924274:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788642164.925259:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef152d80 x1875527107372928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642164.925282:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107372928:0@lo:13: 00010000:00010000:3.0:1788642165.690412:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642165.946445:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788642165.946470:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107373056:0@lo:13: 00000100:00100000:1.0:1788642165.946540:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642165.946632:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107373056 00000100:00100000:2.0:1788642165.946649:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107373056 00000100:00100000:2.0:1788642165.946737:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788642165.946748:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107373056:12345-0@lo:13: 00002000:00000024:2.0:1788642165.946801:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642165.946895:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef153800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107373056:12345-0@lo:13: Request processed in 149us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642165.946904:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788642165.946947:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf3b80 x1875527107373056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642165.947003:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107373056:0@lo:13: 00010000:00010000:0.0:1788642166.714333:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642167.744592:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788642168.002989:0:8471:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1561cf60 20000000:00000080:3.0:1788642168.003009:0:8471:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ddcc4a46000 uarg=0000000000000000 20000000:01000000:3.0:1788642168.003045:0:8471:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788642168.003048:0:8471:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788642168.003050:0:8471:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788642168.003054:0:8471:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788642168.003059:0:8471:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788642168.003071:0:8471:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788642168.003073:0:8471:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788642168.003320:0:8471:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788642168.003323:0:8471:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788642168.004363:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788642168.004870:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788642168.004937:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788642168.004968:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788642168.004983:0:8471:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788642168.004984:0:8471:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788642168.006820:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788642168.007289:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788642168.007334:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788642168.007376:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788642168.007392:0:8471:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788642168.007395:0:8471:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788642168.008364:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788642168.008802:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788642168.008840:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788642168.008879:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788642168.008892:0:8471:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788642168.008894:0:8471:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788642168.014541:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788642168.017774:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788642168.017858:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788642168.017898:0:8471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:2.0:1788642168.017916:0:8471:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788642168.017935:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.017953:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d05d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d056 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.017960:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddcfb51e00/0x4ae1ee156666d087 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d080 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.017975:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddcfb50800/0x4ae1ee156666d0b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d0aa expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.017983:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d0bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d0b8 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.017990:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc9832200/0x4ae1ee156666d0cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d0c6 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.017996:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d0e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d0e2 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.018003:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d113 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d10c expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.018012:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a964a expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.018019:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666d128 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9651 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.018027:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.018064:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666d128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9651 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.018079:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666d128 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9651 expref: 9 pid: 5856 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.019605:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373184:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642168.019807:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a964a expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.019821:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d121 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a964a expref: 9 pid: 5853 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.019833:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373312:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642168.019870:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d113 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d10c expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.019879:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d113 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d10c expref: 18 pid: 5854 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.019888:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373440:0@lo:104: 00000100:00100000:2.0:1788642168.019934:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788642168.019973:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d0e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d0e2 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.019982:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d0e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d0e2 expref: 18 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.019990:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373568:0@lo:104: 00000100:00100000:2.0:1788642168.020015:0:8471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788642168.020035:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc9832200/0x4ae1ee156666d0cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d0c6 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.020043:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddc9832200/0x4ae1ee156666d0cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d0c6 expref: 18 pid: 5854 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.020061:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9efb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373696:0@lo:104: 00010000:00010000:2.0:1788642168.020089:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d0bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d0b8 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.020120:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d0bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d0b8 expref: 18 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.020129:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373824:0@lo:104: 00010000:00010000:2.0:1788642168.020163:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddcfb50800/0x4ae1ee156666d0b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d0aa expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.020171:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddcfb50800/0x4ae1ee156666d0b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d0aa expref: 18 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.020179:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9eca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373952:0@lo:104: 00010000:00010000:2.0:1788642168.020201:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddcfb51e00/0x4ae1ee156666d087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d080 expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.020209:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddcfb51e00/0x4ae1ee156666d087 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d080 expref: 18 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.020215:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107374080:0@lo:104: 00010000:00010000:2.0:1788642168.020240:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d05d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d056 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642168.020248:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d05d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d056 expref: 18 pid: 5853 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.020267:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107374208:0@lo:104: 00000100:00100000:2.0:1788642168.020286:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642168.020370:0:5843:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788642168.020388:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642168.020411:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642168.020420:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642168.020444:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642168.020455:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642168.020463:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107373440 00000100:00100000:0.0:1788642168.020470:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107373440 00000100:00100000:0.0:1788642168.020505:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107373568 00000100:00100000:0.0:1788642168.020508:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107373568 00000100:00100000:0.0:1788642168.020519:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107373696 00000100:00100000:0.0:1788642168.020522:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107373696 00000100:00100000:0.0:1788642168.020530:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107373824 00000100:00100000:0.0:1788642168.020532:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107373824 00000100:00100000:0.0:1788642168.020541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107373952 00000100:00100000:0.0:1788642168.020543:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107373952 00000100:00100000:0.0:1788642168.020550:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107374080 00000100:00100000:0.0:1788642168.020552:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107374080 00000100:00100000:0.0:1788642168.020561:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107374208 00000100:00100000:0.0:1788642168.020563:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107374208 00000100:00100000:0.0:1788642168.020574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788642168.020581:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+9:8471:x1875527107373440:12345-0@lo:104: 00010000:00010000:0.0:1788642168.020600:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d113 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.020654:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788642168.020660:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+9:8471:x1875527107373440:12345-0@lo:104: Request processed in 80us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.020667:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788642168.020684:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788642168.020689:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5c48450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+8:8471:x1875527107373568:12345-0@lo:104: 00010000:00010000:0.0:1788642168.020696:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d0e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.020739:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788642168.020744:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5c48450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+8:8471:x1875527107373568:12345-0@lo:104: Request processed in 55us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.020750:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788642168.020780:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788642168.020786:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+7:8471:x1875527107373696:12345-0@lo:104: 00010000:00010000:0.0:1788642168.020792:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d0cd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.020824:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788642168.020829:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+7:8471:x1875527107373696:12345-0@lo:104: Request processed in 45us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.020835:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788642168.020847:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788642168.020853:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+6:8471:x1875527107373824:12345-0@lo:104: 00010000:00010000:0.0:1788642168.020866:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d0bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.020891:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788642168.020895:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+6:8471:x1875527107373824:12345-0@lo:104: Request processed in 44us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.020900:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788642168.020911:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788642168.020915:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:8471:x1875527107373952:12345-0@lo:104: 00010000:00010000:0.0:1788642168.020921:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d0b1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.020938:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788642168.020942:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:8471:x1875527107373952:12345-0@lo:104: Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.020947:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788642168.020954:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788642168.020958:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:8471:x1875527107374080:12345-0@lo:104: 00010000:00010000:0.0:1788642168.020963:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d087 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.020980:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788642168.020983:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:8471:x1875527107374080:12345-0@lo:104: Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.020988:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788642168.020996:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788642168.021000:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:8471:x1875527107374208:12345-0@lo:104: 00010000:00010000:0.0:1788642168.021011:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d05d expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021031:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788642168.021035:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:8471:x1875527107374208:12345-0@lo:104: Request processed in 35us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.021039:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788642168.021058:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788642168.021062:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d113 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021068:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121400 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642168.021072:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d113 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021081:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d113 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642168.021087:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d113 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642168.021092:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788642168.021148:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d113 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021154:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642168.021173:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d113 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021180:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddd6121400/0x4ae1ee156666d10c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d113 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021200:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788642168.021203:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d0e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021208:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9832400 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642168.021211:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d0e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021218:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d0e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642168.021224:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d0e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642168.021228:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788642168.021241:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d0e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021247:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642168.021261:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d0e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021267:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d0e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d0e9 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021276:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788642168.021279:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d0cd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021293:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f8400 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642168.021296:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d0cd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021302:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d0cd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642168.021309:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d0cd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642168.021314:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788642168.021328:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d0cd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021333:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642168.021337:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d0cd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021343:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dde021f8400/0x4ae1ee156666d0c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d0cd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021353:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788642168.021356:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d0bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021361:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50000 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642168.021364:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d0bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021397:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d0bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642168.021403:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d0bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642168.021408:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788642168.021421:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d0bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021427:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642168.021432:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d0bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021438:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d0b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d0bf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021447:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788642168.021449:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d0b1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021454:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9000 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642168.021456:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d0b1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021462:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d0b1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642168.021468:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d0b1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642168.021479:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788642168.021493:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d0b1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021499:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642168.021504:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d0b1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021509:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dde021f9000/0x4ae1ee156666d0aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d0b1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021518:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788642168.021521:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d087 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021525:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51000 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642168.021528:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d087 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021534:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d087 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642168.021538:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d087 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642168.021543:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788642168.021554:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d087 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021559:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642168.021570:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d087 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021576:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51000/0x4ae1ee156666d080 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d087 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021584:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642168.021587:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d05d expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021593:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50200 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642168.021596:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d05d expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021602:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d05d expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642168.021608:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d05d expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642168.021613:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788642168.021626:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d05d expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021630:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642168.021633:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d05d expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021639:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d056 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d05d expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.021655:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642168.021661:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642168.021663:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642168.021671:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642168.021676:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642168.021699:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107374336:0@lo:103: 00000100:00100000:0.0:1788642168.021748:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642168.021771:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107374848:0@lo:103: 00000100:00100000:0.0:1788642168.021791:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642168.021812:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788642168.021818:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107374720:0@lo:103: 00000100:00100000:0.0:1788642168.021840:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642168.021869:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107374464:0@lo:103: 00000100:00100000:0.0:1788642168.021891:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642168.021901:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107374976:0@lo:103: 00000100:00100000:0.0:1788642168.021917:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642168.021927:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788642168.021933:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107374592:0@lo:103: 00000100:00100000:0.0:1788642168.021950:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642168.021959:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107375104:0@lo:103: 00000100:00100000:0.0:1788642168.021977:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642168.022001:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107374336 00000100:00100000:0.0:1788642168.022007:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107374336 00010000:00010000:0.0:1788642168.022029:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d113 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d10c expref: 19 pid: 5854 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642168.022044:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107374848 00000100:00100000:0.0:1788642168.022046:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107374848 00010000:00010000:0.0:1788642168.022053:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddcfb50800/0x4ae1ee156666d0b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d0aa expref: 20 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642168.022069:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107374720 00000100:00100000:0.0:1788642168.022071:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107374720 00010000:00010000:0.0:1788642168.022080:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d0bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d0b8 expref: 21 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642168.022087:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107374464 00000100:00100000:0.0:1788642168.022088:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107374464 00010000:00010000:0.0:1788642168.022095:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d0e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d0e2 expref: 22 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642168.022123:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107374976 00000100:00100000:0.0:1788642168.022126:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107374976 00010000:00010000:0.0:1788642168.022134:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddcfb51e00/0x4ae1ee156666d087 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d080 expref: 23 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642168.022141:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107374592 00000100:00100000:0.0:1788642168.022142:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107374592 00010000:00010000:0.0:1788642168.022148:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc9832200/0x4ae1ee156666d0cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d0c6 expref: 24 pid: 5854 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642168.022155:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107375104 00000100:00100000:0.0:1788642168.022157:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107375104 00010000:00010000:0.0:1788642168.022163:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d05d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d056 expref: 25 pid: 5853 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642168.022172:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788642168.022177:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+25:3320:x1875527107374336:12345-0@lo:103: 00010000:00010000:0.0:1788642168.022186:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642168.022191:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d113 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d10c expref: 25 pid: 5854 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022211:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d113 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d10c expref: 25 pid: 5854 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022226:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642168.022256:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+25:3320:x1875527107374336:12345-0@lo:103: Request processed in 79us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.022263:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788642168.022277:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788642168.022283:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+24:3320:x1875527107374848:12345-0@lo:103: 00010000:00010000:0.0:1788642168.022291:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642168.022296:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddcfb50800/0x4ae1ee156666d0b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d0aa expref: 24 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022304:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddcfb50800/0x4ae1ee156666d0b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d0aa expref: 24 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022313:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642168.022335:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+24:3320:x1875527107374848:12345-0@lo:103: Request processed in 52us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.022340:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788642168.022353:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788642168.022358:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+23:3320:x1875527107374720:12345-0@lo:103: 00010000:00010000:0.0:1788642168.022366:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642168.022370:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d0bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d0b8 expref: 23 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022377:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d0bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d0b8 expref: 23 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022392:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642168.022414:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+23:3320:x1875527107374720:12345-0@lo:103: Request processed in 56us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.022420:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788642168.022433:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788642168.022438:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+22:3317:x1875527107374464:12345-0@lo:103: 00010000:00010000:0.0:1788642168.022445:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642168.022448:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d0e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d0e2 expref: 22 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022455:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d0e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d0e2 expref: 22 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022463:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642168.022484:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+22:3317:x1875527107374464:12345-0@lo:103: Request processed in 46us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.022489:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788642168.022499:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788642168.022503:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+21:3317:x1875527107374976:12345-0@lo:103: 00010000:00010000:0.0:1788642168.022509:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642168.022512:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddcfb51e00/0x4ae1ee156666d087 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d080 expref: 21 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022518:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddcfb51e00/0x4ae1ee156666d087 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d080 expref: 21 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022525:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642168.022547:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+21:3317:x1875527107374976:12345-0@lo:103: Request processed in 44us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.022552:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788642168.022561:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788642168.022565:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+20:3317:x1875527107374592:12345-0@lo:103: 00010000:00010000:0.0:1788642168.022571:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642168.022574:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc9832200/0x4ae1ee156666d0cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d0c6 expref: 20 pid: 5854 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022581:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc9832200/0x4ae1ee156666d0cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d0c6 expref: 20 pid: 5854 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022590:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642168.022609:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+20:3317:x1875527107374592:12345-0@lo:103: Request processed in 43us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.022613:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788642168.022624:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788642168.022629:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddde4e64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107375104:12345-0@lo:103: 00010000:00010000:0.0:1788642168.022636:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642168.022639:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d05d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d056 expref: 19 pid: 5853 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022646:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d05d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d056 expref: 19 pid: 5853 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.022655:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642168.022672:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddde4e64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107375104:12345-0@lo:103: Request processed in 43us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.022677:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788642168.022752:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107374592:0@lo:103: 00000100:00100000:0.0:1788642168.022760:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107375104:0@lo:103: 00000100:00100000:0.0:1788642168.022766:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107374464:0@lo:103: 00000100:00100000:0.0:1788642168.022772:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107374976:0@lo:103: 00000100:00100000:0.0:1788642168.022800:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107374720:0@lo:103: 00000100:00100000:0.0:1788642168.022807:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107374336:0@lo:103: 00000100:00100000:0.0:1788642168.022814:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107374848:0@lo:103: 00010000:00010000:2.0:1788642168.023008:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d113 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d10c expref: 18 pid: 5854 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.023021:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373440:0@lo:104: 00010000:00010000:2.0:1788642168.023029:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d0e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d0e2 expref: 17 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.023036:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373568:0@lo:104: 00010000:00010000:2.0:1788642168.023043:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9832200/0x4ae1ee156666d0cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d0c6 expref: 16 pid: 5854 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.023048:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9efb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373696:0@lo:104: 00010000:00010000:2.0:1788642168.023056:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d0bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d0b8 expref: 15 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.023063:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373824:0@lo:104: 00010000:00010000:2.0:1788642168.023070:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddcfb50800/0x4ae1ee156666d0b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d0aa expref: 14 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.023076:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9eca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373952:0@lo:104: 00010000:00010000:2.0:1788642168.023084:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddcfb51e00/0x4ae1ee156666d087 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d080 expref: 13 pid: 5856 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.023090:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107374080:0@lo:104: 00010000:00010000:2.0:1788642168.023119:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9833000/0x4ae1ee156666d05d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d056 expref: 12 pid: 5853 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.023133:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107374208:0@lo:104: 00000100:00100000:3.0:1788642168.030599:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373184:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642168.031025:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8471:1875527107373312:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788642168.031067:0:8471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642168.037605:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642168.037651:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642168.037743:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086379136 00000100:00100000:0.0:1788642168.037753:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086379136 00010000:00010000:0.0:1788642168.037794:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d121 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a964a expref: 10 pid: 5853 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642168.037837:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086379008 00000100:00100000:0.0:1788642168.037840:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086379008 00010000:00010000:0.0:1788642168.037853:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666d128 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9651 expref: 11 pid: 5856 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642168.037868:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:0.0:1788642168.037876:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+11:2359:x1875527086379136:12345-192.168.202.49@tcp:103: 00010000:00010000:0.0:1788642168.037891:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642168.037896:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d121 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a964a expref: 11 pid: 5853 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.037906:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a964a expref: 11 pid: 5853 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.037940:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d121 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a964a expref: 11 pid: 5853 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.037958:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642168.038011:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086379136:12345-192.168.202.49@tcp:103: Request processed in 136us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.038017:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:0.0:1788642168.038032:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:0.0:1788642168.038037:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+9:2360:x1875527086379008:12345-192.168.202.49@tcp:103: 00010000:00010000:0.0:1788642168.038044:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642168.038047:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666d128 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9651 expref: 9 pid: 5856 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.038055:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666d128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9651 expref: 9 pid: 5856 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.038064:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddcfb50a00/0x4ae1ee156666d128 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9651 expref: 9 pid: 5856 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.038074:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.038081:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.038093:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.038138:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.038149:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.038155:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.038161:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642168.038165:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.038173:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.038183:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.038194:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642168.038215:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+8:2360:x1875527086379008:12345-192.168.202.49@tcp:103: Request processed in 177us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642168.038221:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00010000:00010000:3.0:1788642168.038660:0:8471:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642168.038670:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642168.038676:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d160 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642168.762410:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642168.992407:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642168.992521:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642168.992586:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642168.992721:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086379392 00000100:00100000:2.0:1788642168.992736:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086379392 00000100:00100000:2.0:1788642168.992830:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:2.0:1788642168.992841:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2360:x1875527086379392:12345-192.168.202.49@tcp:400: 00000100:00100000:2.0:1788642168.992937:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2360:x1875527086379392:12345-192.168.202.49@tcp:400: Request processed in 98us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642168.993002:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00080000:0.0:1788642168.993352:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642168.994401:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086379520 00000100:00100000:3.0:1788642168.994414:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086379520 00000100:00100000:3.0:1788642168.994523:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:3.0:1788642168.994546:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086379520:12345-192.168.202.49@tcp:400: 00000100:00100000:3.0:1788642168.994628:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086379520:12345-192.168.202.49@tcp:400: Request processed in 96us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642168.994637:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00080000:0.0:1788642168.995844:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788642168.999036:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642168.999399:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086379648 00000100:00100000:3.0:1788642168.999413:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086379648 00000100:00100000:3.0:1788642168.999507:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:3.0:1788642168.999518:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086379648:12345-192.168.202.49@tcp:400: 00000100:00100000:3.0:1788642168.999612:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086379648:12345-192.168.202.49@tcp:400: Request processed in 96us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642168.999620:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00080000:0.0:1788642169.000597:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788642169.001360:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086379264 00000100:00100000:1.0:1788642169.001375:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086379264 00000100:00100000:1.0:1788642169.001448:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 131 00000100:00100000:1.0:1788642169.001459:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+8:2360:x1875527086379264:12345-192.168.202.49@tcp:400: 00000100:00100000:1.0:1788642169.001565:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+8:2360:x1875527086379264:12345-192.168.202.49@tcp:400: Request processed in 107us (9172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642169.001572:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 131 10000000:01000000:0.0:1788642169.402273:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788642169.402309:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ddcc509b000 from 39 10000000:01000000:0.0:1788642169.402317:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788642169.402394:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.402409:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.402424:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642169.402454:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107375232:0@lo:101: 00000100:00100000:0.0:1788642169.402568:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642169.402665:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd9e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642169.402784:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107375232 00000100:00100000:2.0:1788642169.402802:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107375232 00000100:00100000:2.0:1788642169.402880:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788642169.402893:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+12:5858:x1875527107375232:12345-0@lo:101: 00010000:00010000:2.0:1788642169.402919:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642169.402939:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dde021f9200/0x4ae1ee156666d16e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d167 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.402986:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f9200/0x4ae1ee156666d16e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d167 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.402999:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dde021f9200/0x4ae1ee156666d16e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d167 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.403010:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f9200, rc 0) 00000100:00100000:2.0:1788642169.403074:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107375232:12345-0@lo:101: Request processed in 185us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.403094:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788642169.403152:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107375232:0@lo:101: 00010000:00010000:0.0:1788642169.403174:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.403187:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642169.403261:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107375360:0@lo:501: 00000100:00100000:0.0:1788642169.403292:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642169.403386:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd9e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788642169.404164:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107375360 00000100:00100000:3.0:1788642169.404176:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107375360 00000100:00100000:3.0:1788642169.404363:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788642169.404375:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107375360:12345-0@lo:501: 00000100:00100000:3.0:1788642169.404803:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107375360:12345-0@lo:501: Request processed in 428us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642169.404812:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788642169.404926:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107375360:0@lo:501: 00000100:00100000:0.0:1788642169.404987:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107375488:0@lo:503: 00000100:00100000:0.0:1788642169.405041:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642169.406174:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd9e0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788642169.406503:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107375488 00000100:00100000:1.0:1788642169.406517:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107375488 00000100:00100000:1.0:1788642169.406574:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788642169.406585:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107375488:12345-0@lo:503: 00000100:00100000:1.0:1788642169.406891:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107375488:12345-0@lo:503: Request processed in 305us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642169.406898:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788642169.407165:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107375488:0@lo:503: 00000100:00100000:0.0:1788642169.408199:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8489:1875527107375616:0@lo:502: 00000100:00100000:0.0:1788642169.408283:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642169.408327:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd9e0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788642169.409047:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107375616 00000100:00100000:1.0:1788642169.409060:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107375616 00000100:00100000:1.0:1788642169.409156:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788642169.409167:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:8489:x1875527107375616:12345-0@lo:502: 00000100:00100000:1.0:1788642169.409667:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:8489:x1875527107375616:12345-0@lo:502: Request processed in 500us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642169.409677:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788642169.409977:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8489:1875527107375616:0@lo:502: 00000100:00100000:0.0:1788642169.410057:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8489:1875527107375744:0@lo:502: 00000100:00100000:0.0:1788642169.410148:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642169.410179:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd9e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788642169.410323:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107375744 00000100:00100000:3.0:1788642169.410331:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107375744 00000100:00100000:3.0:1788642169.410440:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788642169.410450:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:8489:x1875527107375744:12345-0@lo:502: 00000100:00100000:3.0:1788642169.410647:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:8489:x1875527107375744:12345-0@lo:502: Request processed in 198us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642169.410655:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788642169.410777:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8489:1875527107375744:0@lo:502: 00000040:00080000:0.0:1788642169.410799:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788642169.411457:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788642169.411480:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788642169.411493:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642169.411507:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642169.411518:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788642169.411521:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788642169.411525:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788642169.411562:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642169.411571:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642169.411583:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642169.411605:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107375872:0@lo:101: 00000100:00100000:3.0:1788642169.411655:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.411693:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642169.411808:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107375872 00000100:00100000:0.0:1788642169.411815:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107375872 00000100:00100000:0.0:1788642169.411930:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788642169.411940:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+13:5858:x1875527107375872:12345-0@lo:101: 00010000:00010000:0.0:1788642169.411951:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642169.411967:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9832c00/0x4ae1ee156666d17c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d175 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.411995:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9832c00/0x4ae1ee156666d17c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d175 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.412006:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9832c00/0x4ae1ee156666d17c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d175 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.412016:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9832c00, rc 0) 00000100:00100000:0.0:1788642169.412062:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107375872:12345-0@lo:101: Request processed in 123us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.412082:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788642169.412332:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107375872:0@lo:101: 00010000:00010000:3.0:1788642169.412423:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642169.412435:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642169.412512:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107376000:0@lo:501: 00000100:00100000:3.0:1788642169.412546:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.412630:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642169.412954:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107376000 00000100:00100000:2.0:1788642169.412963:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107376000 00000100:00100000:2.0:1788642169.414903:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788642169.414935:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107376000:12345-0@lo:501: 00000100:00100000:2.0:1788642169.415828:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107376000:12345-0@lo:501: Request processed in 904us (3275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.415852:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788642169.416080:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107376000:0@lo:501: 00000100:00100000:3.0:1788642169.416207:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107376128:0@lo:503: 00000100:00100000:3.0:1788642169.416272:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.416825:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642169.417016:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107376128 00000100:00100000:0.0:1788642169.417026:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107376128 00000100:00100000:0.0:1788642169.417080:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788642169.417090:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107376128:12345-0@lo:503: 00000100:00100000:0.0:1788642169.417907:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107376128:12345-0@lo:503: Request processed in 812us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.417918:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788642169.418079:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107376128:0@lo:503: 00000100:00100000:3.0:1788642169.419459:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8490:1875527107376256:0@lo:502: 00000100:00100000:3.0:1788642169.419564:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.419611:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788642169.419749:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107376256 00000100:00100000:0.0:1788642169.419758:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107376256 00000100:00100000:0.0:1788642169.419804:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788642169.419814:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:8490:x1875527107376256:12345-0@lo:502: 00000100:00100000:0.0:1788642169.420152:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:8490:x1875527107376256:12345-0@lo:502: Request processed in 337us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.420160:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788642169.420738:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8490:1875527107376256:0@lo:502: 00000020:01000000:3.0:1788642169.420782:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788642169.420796:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788642169.420799:0:8490:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788642169.420806:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788642169.420841:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8490:1875527107376384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642169.420899:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.420945:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788642169.421049:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107376384 00000100:00100000:0.0:1788642169.421056:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107376384 00000100:00100000:0.0:1788642169.421143:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788642169.421154:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:8490:x1875527107376384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642169.421561:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:8490:x1875527107376384:12345-0@lo:502:llog_process_th.0 Request processed in 408us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.421569:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788642169.421658:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8490:1875527107376384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788642169.421681:0:8490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788642169.421688:0:8490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788642169.421689:0:8490:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788642169.421694:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788642169.422167:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788642169.422215:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788642169.422229:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.422254:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642169.422266:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788642169.422269:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dddef9be800 from 39 10000000:01000000:0.0:1788642169.422273:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788642169.422312:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.422321:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.422331:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642169.422366:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107376512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788642169.422415:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642169.422447:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd9e0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788642169.422623:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107376512 00000100:00100000:2.0:1788642169.422630:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107376512 00000100:00100000:2.0:1788642169.422678:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788642169.422688:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:5858:x1875527107376512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642169.422700:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642169.422716:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d18a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d183 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.422755:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d18a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d183 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.422767:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d18a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d183 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.422778:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f8c00, rc 0) 00000100:00100000:2.0:1788642169.422826:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107376512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.422832:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788642169.423024:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107376512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788642169.423042:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642169.423053:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642169.423147:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107376640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642169.423252:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.423278:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfe180 going to sleep for 11 seconds 00000100:00100000:2.0:1788642169.423331:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107376640 00000100:00100000:2.0:1788642169.423355:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107376640 00000100:00100000:2.0:1788642169.423381:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788642169.423388:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107376640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788642169.423709:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107376640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.423717:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788642169.423926:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107376640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642169.423963:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107376768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642169.424006:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.424040:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788642169.424146:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107376768 00000100:00100000:0.0:1788642169.424151:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107376768 00000100:00100000:0.0:1788642169.424175:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788642169.424194:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107376768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788642169.424503:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107376768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 309us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.424511:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788642169.424604:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107376768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642169.425079:0:8491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8491:1875527107376896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642169.425159:0:8491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.425259:0:8491:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfe300 going to sleep for 11 seconds 00000100:00100000:0.0:1788642169.425330:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107376896 00000100:00100000:0.0:1788642169.425453:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107376896 00000100:00100000:0.0:1788642169.425495:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788642169.425511:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:8491:x1875527107376896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642169.425920:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:8491:x1875527107376896:12345-0@lo:502:llog_process_th.0 Request processed in 408us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.425929:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788642169.426331:0:8491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8491:1875527107376896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642169.426483:0:8491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8491:1875527107377024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642169.426532:0:8491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.426568:0:8491:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfe300 going to sleep for 11 seconds 00000100:00100000:2.0:1788642169.426625:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107377024 00000100:00100000:2.0:1788642169.426632:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107377024 00000100:00100000:2.0:1788642169.426675:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788642169.426685:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:8491:x1875527107377024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642169.427026:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:8491:x1875527107377024:12345-0@lo:502:llog_process_th.0 Request processed in 340us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.427033:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788642169.427146:0:8491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8491:1875527107377024:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788642169.427170:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788642169.427671:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788642169.427697:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788642169.427711:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642169.427723:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642169.427809:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788642169.427812:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788642169.427817:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788642169.427856:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642169.427864:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642169.427875:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642169.427899:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107377152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788642169.427944:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642169.428034:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72600 going to sleep for 11 seconds 00000100:00100000:2.0:1788642169.428080:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107377152 00000100:00100000:2.0:1788642169.428086:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107377152 00000100:00100000:2.0:1788642169.428443:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788642169.428455:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:5858:x1875527107377152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642169.428469:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642169.428487:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d191 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.428517:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d191 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.428529:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d191 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.428539:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f9600, rc 0) 00000100:00100000:2.0:1788642169.428601:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107377152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.428608:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788642169.428688:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107377152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788642169.428704:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642169.428715:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642169.428799:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107377280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642169.428829:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642169.429002:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72600 going to sleep for 11 seconds 00000100:00100000:3.0:1788642169.429082:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107377280 00000100:00100000:3.0:1788642169.429089:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107377280 00000100:00100000:3.0:1788642169.429145:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788642169.429153:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107377280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642169.429672:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107377280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 517us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642169.429679:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788642169.429920:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107377280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642169.429966:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107377408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642169.430023:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642169.430085:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72600 going to sleep for 11 seconds 00000100:00100000:3.0:1788642169.430303:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107377408 00000100:00100000:3.0:1788642169.430310:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107377408 00000100:00100000:3.0:1788642169.430458:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788642169.430467:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107377408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642169.430666:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107377408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642169.430673:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788642169.430762:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107377408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642169.431441:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8492:1875527107377536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788642169.431495:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642169.431857:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd7bd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788642169.431931:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107377536 00000100:00100000:2.0:1788642169.431939:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107377536 00000100:00100000:2.0:1788642169.431978:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788642169.431988:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:8492:x1875527107377536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642169.432549:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:8492:x1875527107377536:12345-0@lo:502:llog_process_th.0 Request processed in 558us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.432558:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788642169.434671:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8492:1875527107377536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788642169.434862:0:8492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788642169.434879:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642169.434882:0:8492:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788642169.434890:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788642169.434956:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8492:1875527107377664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788642169.435557:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642169.435708:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd7bd480 going to sleep for 11 seconds 00000100:00100000:3.0:1788642169.435823:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107377664 00000100:00100000:3.0:1788642169.435833:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107377664 00000100:00100000:3.0:1788642169.435949:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788642169.435960:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:8492:x1875527107377664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642169.436536:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:8492:x1875527107377664:12345-0@lo:502:llog_process_th.0 Request processed in 388us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642169.436549:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788642169.436765:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8492:1875527107377664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788642169.436803:0:8492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642169.436812:0:8492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642169.436815:0:8492:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788642169.436828:0:8492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788642169.440823:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788642169.440874:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788642169.440890:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.440908:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642169.440923:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788642169.440928:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dddc599b800 from 39 10000000:01000000:0.0:1788642169.440932:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788642169.440993:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.441003:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.441017:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642169.441063:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107377792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788642169.441190:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642169.442220:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd9e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642169.442704:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107377792 00000100:00100000:2.0:1788642169.442717:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107377792 00000100:00100000:2.0:1788642169.442864:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788642169.442876:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107377792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642169.442897:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642169.442920:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dde021f9000/0x4ae1ee156666d1a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d19f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.442951:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f9000/0x4ae1ee156666d1a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d19f expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.442965:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dde021f9000/0x4ae1ee156666d1a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d19f expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.442976:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f9000, rc 0) 00000100:00100000:2.0:1788642169.443985:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107377792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1103us (2786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.443997:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788642169.444495:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107377792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788642169.444537:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.444551:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642169.444717:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107377920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642169.445003:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.445168:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107377920 00000100:00100000:3.0:1788642169.445176:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107377920 00000100:00100000:3.0:1788642169.445254:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788642169.445265:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107377920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642169.445535:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd9e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788642169.446446:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107377920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1176us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642169.446467:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788642169.446632:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107377920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642169.446698:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107378048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788642169.446767:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642169.446812:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd9e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642169.447497:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107378048 00000100:00100000:2.0:1788642169.447509:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107378048 00000100:00100000:2.0:1788642169.447573:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788642169.447591:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107378048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788642169.447859:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107378048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 277us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.447866:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788642169.448181:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107378048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642169.449288:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8493:1875527107378176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642169.449466:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.449564:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfe600 going to sleep for 11 seconds 00000100:00100000:0.0:1788642169.449684:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107378176 00000100:00100000:0.0:1788642169.449694:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107378176 00000100:00100000:0.0:1788642169.449869:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788642169.449881:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:8493:x1875527107378176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642169.450279:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:8493:x1875527107378176:12345-0@lo:502:llog_process_th.0 Request processed in 399us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.450288:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788642169.450407:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8493:1875527107378176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642169.450481:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8493:1875527107378304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642169.450527:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.451026:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfe600 going to sleep for 11 seconds 00000100:00100000:2.0:1788642169.451260:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107378304 00000100:00100000:2.0:1788642169.451268:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107378304 00000100:00100000:2.0:1788642169.451312:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788642169.451322:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:8493:x1875527107378304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642169.451880:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:8493:x1875527107378304:12345-0@lo:502:llog_process_th.0 Request processed in 555us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.451891:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788642169.452334:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8493:1875527107378304:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788642169.452475:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788642169.452851:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788642169.452873:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788642169.452887:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.452918:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642169.452931:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788642169.452934:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788642169.452937:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788642169.452979:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.452988:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.452998:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642169.453024:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107378432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788642169.453290:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642169.453458:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd9e0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642169.453518:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107378432 00000100:00100000:2.0:1788642169.453527:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107378432 00000100:00100000:2.0:1788642169.453692:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788642169.453703:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107378432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642169.453788:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642169.453810:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d1b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d1ad expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.453843:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d1b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d1ad expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.453857:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d1b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d1ad expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.453882:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f8400, rc 0) 00000100:00100000:2.0:1788642169.453981:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107378432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 281us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.453989:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788642169.454226:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107378432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788642169.454245:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642169.454256:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642169.454337:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107378560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642169.454442:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642169.454510:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd7bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788642169.454652:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107378560 00000100:00100000:3.0:1788642169.454659:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107378560 00000100:00100000:3.0:1788642169.454972:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788642169.454984:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107378560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642169.455419:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107378560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 435us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642169.455427:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788642169.455530:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107378560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642169.455590:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107378688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642169.455640:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642169.456271:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd7bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1788642169.456308:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107378688 00000100:00100000:0.0:1788642169.456317:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107378688 00000100:00100000:0.0:1788642169.456429:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788642169.456439:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107378688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788642169.456824:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107378688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 386us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.456832:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788642169.457536:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107378688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642169.458279:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8494:1875527107378816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642169.458556:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.458702:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788642169.459294:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107378816 00000100:00100000:0.0:1788642169.459306:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107378816 00000100:00100000:0.0:1788642169.459482:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788642169.459504:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:8494:x1875527107378816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642169.460059:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:8494:x1875527107378816:12345-0@lo:502:llog_process_th.0 Request processed in 554us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.460069:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788642169.460478:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8494:1875527107378816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788642169.460522:0:8494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788642169.460534:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788642169.460545:0:8494:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788642169.460553:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788642169.460670:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8494:1875527107378944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642169.460787:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.460866:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788642169.460925:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107378944 00000100:00100000:0.0:1788642169.460932:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107378944 00000100:00100000:0.0:1788642169.461247:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788642169.461259:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:8494:x1875527107378944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642169.461524:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:8494:x1875527107378944:12345-0@lo:502:llog_process_th.0 Request processed in 267us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.461533:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788642169.461760:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8494:1875527107378944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788642169.461789:0:8494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642169.461796:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642169.461798:0:8494:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788642169.461804:0:8494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788642169.462465:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788642169.462495:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788642169.462509:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.462522:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642169.462533:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788642169.462536:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dddc4e04d40 from 1 10000000:01000000:0.0:1788642169.462539:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788642169.462689:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832200/0x4ae1ee156666d1bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.462700:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddc9832200/0x4ae1ee156666d1bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.462711:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddc9832200/0x4ae1ee156666d1bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642169.462814:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107379072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788642169.462878:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642169.462958:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd9e00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642169.463007:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107379072 00000100:00100000:3.0:1788642169.463015:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107379072 00000100:00100000:3.0:1788642169.463301:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788642169.463312:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107379072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788642169.463326:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642169.463415:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d1c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d1bb expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642169.463447:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d1c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d1bb expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642169.463459:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d1c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d1bb expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642169.463468:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6120400, rc 0) 00000100:00100000:3.0:1788642169.463559:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107379072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642169.463567:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788642169.463789:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107379072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788642169.463809:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddc9832200/0x4ae1ee156666d1bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1c2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642169.463819:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddc9832200/0x4ae1ee156666d1bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d1c2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642169.463893:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107379200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642169.463925:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642169.464011:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd7bd240 going to sleep for 11 seconds 00000100:00100000:2.0:1788642169.464281:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107379200 00000100:00100000:2.0:1788642169.464288:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107379200 00000100:00100000:2.0:1788642169.464329:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788642169.464439:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107379200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788642169.464914:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107379200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 576us (986us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788642169.464922:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788642169.465011:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107379200:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788642169.465057:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788642169.465068:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832200/0x4ae1ee156666d1bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1c2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642169.465077:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddc9832200/0x4ae1ee156666d1bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1c2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642169.530676:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107379712:0@lo:400:kworker.0 00000100:00100000:0.0:1788642169.530855:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107379328:0@lo:400:kworker.0 00000100:00100000:0.0:1788642169.530967:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642169.531065:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107379840:0@lo:400:kworker.0 00000100:00100000:0.0:1788642169.531129:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642169.531170:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642169.531177:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107379456:0@lo:400:kworker.0 00000100:00100000:0.0:1788642169.531215:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.531449:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.531472:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788642169.531479:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107379584:0@lo:400:kworker.0 00000100:00100000:3.0:1788642169.531504:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642169.531638:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107379328 00000100:00100000:3.0:1788642169.531649:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107379328 00000100:00100000:0.0:1788642169.531782:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107379456 00000100:00100000:0.0:1788642169.531786:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107379456 00000100:00100000:3.0:1788642169.532690:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107379712 00000100:00100000:3.0:1788642169.532698:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107379712 00000100:00080000:1.0:1788642169.532787:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642169.532828:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107379840 00000100:00100000:1.0:1788642169.532833:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107379840 00000100:00100000:1.0:1788642169.532873:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107379584 00000100:00100000:1.0:1788642169.532877:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107379584 00000100:00100000:1.0:1788642169.532899:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788642169.532909:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107379840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642169.533011:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107379840:12345-0@lo:400:kworker.0 Request processed in 104us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642169.533018:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788642169.533038:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788642169.533044:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107379584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642169.533091:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107379584:12345-0@lo:400:kworker.0 Request processed in 47us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642169.533136:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788642169.533165:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788642169.533168:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788642169.533219:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc2f9b480 x1875527107379584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642169.533238:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107379584:0@lo:400:kworker.0 00010000:00080000:1.0:1788642169.533281:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc2f99180 x1875527107379840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642169.533291:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107379840:0@lo:400:kworker.0 00000100:00100000:0.0:1788642169.534849:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788642169.534869:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107379328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642169.535001:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107379328:12345-0@lo:400:kworker.0 Request processed in 141us (4034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.535009:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788642169.535067:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788642169.535075:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107379456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642169.535132:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107379456:12345-0@lo:400:kworker.0 Request processed in 58us (3916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.535139:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788642169.535615:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107379456:0@lo:400:kworker.0 00000100:00100000:0.0:1788642169.535631:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107379328:0@lo:400:kworker.0 00000100:00100000:3.0:1788642169.535884:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788642169.535899:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107379712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642169.535977:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107379712:12345-0@lo:400:kworker.0 Request processed in 83us (4526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642169.535984:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788642169.538800:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107379712:0@lo:400:kworker.0 00010000:00010000:0.0:1788642169.786652:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642169.818437:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642169.818561:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086379776 00000100:00100000:3.0:1788642169.818577:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086379776 00000100:00100000:3.0:1788642169.818662:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 164 00000100:00100000:3.0:1788642169.818675:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+8:5615:x1875527086379776:12345-192.168.202.49@tcp:101: 00010000:00010000:3.0:1788642169.818699:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642169.818733:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6121400/0x4ae1ee156666d1c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a96b3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642169.818778:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6121400/0x4ae1ee156666d1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96b3 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642169.818794:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6121400/0x4ae1ee156666d1c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96b3 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642169.818816:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121400, rc 0) 00000100:00100000:3.0:1788642169.818905:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+9:5615:x1875527086379776:12345-192.168.202.49@tcp:101: Request processed in 232us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642169.818914:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 164 00000100:00100000:2.0:1788642169.823819:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642169.824117:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086379904 00000100:00100000:3.0:1788642169.824132:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086379904 00000100:00100000:3.0:1788642169.824225:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 165 00000100:00100000:3.0:1788642169.824237:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+9:5615:x1875527086379904:12345-192.168.202.49@tcp:501: 00000100:00100000:3.0:1788642169.825473:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+9:5615:x1875527086379904:12345-192.168.202.49@tcp:501: Request processed in 1226us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642169.825488:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 165 00000100:00100000:0.0:1788642169.829875:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642169.833657:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086380032 00000100:00100000:2.0:1788642169.833680:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086380032 00000100:00100000:2.0:1788642169.833867:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 166 00000100:00100000:2.0:1788642169.833881:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+9:5615:x1875527086380032:12345-192.168.202.49@tcp:503: 00000100:00100000:2.0:1788642169.836391:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+9:5615:x1875527086380032:12345-192.168.202.49@tcp:503: Request processed in 2491us (6585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.836414:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 166 00000100:00100000:1.0:1788642169.841395:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642169.845002:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086380160 00000100:00100000:0.0:1788642169.845031:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086380160 00000100:00100000:0.0:1788642169.845156:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 167 00000100:00100000:0.0:1788642169.845172:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+9:6089:x1875527086380160:12345-192.168.202.49@tcp:502: 00000100:00100000:0.0:1788642169.846166:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+9:6089:x1875527086380160:12345-192.168.202.49@tcp:502: Request processed in 991us (4780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642169.846178:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 167 00000100:00100000:3.0:1788642169.851435:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642169.851619:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086380288 00000100:00100000:2.0:1788642169.851633:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086380288 00000100:00100000:2.0:1788642169.851709:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 168 00000100:00100000:2.0:1788642169.851722:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+9:6089:x1875527086380288:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788642169.852425:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+9:6089:x1875527086380288:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 700us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.852436:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 168 00000100:00100000:1.0:1788642169.869483:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642169.870559:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086380416 00000100:00100000:2.0:1788642169.870580:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086380416 00000100:00100000:2.0:1788642169.870671:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 169 00000100:00100000:2.0:1788642169.870685:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+9:5615:x1875527086380416:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642169.870719:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642169.870749:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dde021f9400/0x4ae1ee156666d1d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a96ba expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.871166:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f9400/0x4ae1ee156666d1d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96ba expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.871188:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dde021f9400/0x4ae1ee156666d1d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96ba expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642169.871201:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f9400, rc 0) 00000100:00100000:2.0:1788642169.871395:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:5615:x1875527086380416:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 711us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642169.871404:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 169 00000100:00100000:1.0:1788642169.889510:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642169.889815:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086380544 00000100:00100000:0.0:1788642169.889831:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086380544 00000100:00100000:0.0:1788642169.889979:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 170 00000100:00100000:0.0:1788642169.889993:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:5615:x1875527086380544:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642169.891212:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:5615:x1875527086380544:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 1209us (1720us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788642169.891236:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 170 00000100:00100000:2.0:1788642170.043087:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788642170.043150:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107379968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642170.043454:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642170.049480:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107379968 00000100:00100000:1.0:1788642170.049519:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107379968 00000100:00100000:1.0:1788642170.049643:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788642170.049658:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107379968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642170.049733:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642170.049908:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107379968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 254us (6454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642170.049916:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788642170.050149:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef152a00 x1875527107379968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642170.050204:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107379968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788642170.810752:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642171.073519:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107380096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642171.073624:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642171.073775:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107380096 00000100:00100000:0.0:1788642171.073786:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107380096 00000100:00100000:0.0:1788642171.073879:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788642171.073892:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107380096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788642171.073940:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642171.074013:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107380096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642171.074021:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788642171.074082:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788642171.074153:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfaf80700 x1875527107380096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642171.074178:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107380096:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788642171.511985:0:8532:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc57249a0 20000000:00000080:3.0:1788642171.512012:0:8532:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ddcc4a46800 uarg=0000000000000000 20000000:01000000:3.0:1788642171.512065:0:8532:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788642171.512073:0:8532:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788642171.512081:0:8532:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788642171.517391:0:8533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788642171.517551:0:8532:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788642171.521639:0:8532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788642171.521716:0:8532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788642171.522221:0:8532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788642171.522247:0:8532:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788642171.522517:0:8532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.522540:0:8532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddcfb50c00/0x4ae1ee156666cf61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cf5a expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.522547:0:8532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666cfae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666cfa7 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.522554:0:8532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666d079 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d072 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.522565:0:8532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d136 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9682 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.522592:0:8532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.522646:0:8532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9682 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.522666:0:8532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d136 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9682 expref: 9 pid: 5856 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642171.522684:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875527107380224:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642171.523326:0:8532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666d079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d072 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.523338:0:8532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666d079 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d072 expref: 18 pid: 5853 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642171.523350:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875527107380352:0@lo:104: 00000100:00100000:0.0:1788642171.523407:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788642171.523589:0:8532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666cfae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666cfa7 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.523600:0:8532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666cfae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666cfa7 expref: 18 pid: 5853 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642171.523608:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf83b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875527107380480:0@lo:104: 00000100:00100000:0.0:1788642171.523639:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788642171.523674:0:8532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddcfb50c00/0x4ae1ee156666cf61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666cf5a expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.523697:0:8532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddcfb50c00/0x4ae1ee156666cf61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666cf5a expref: 18 pid: 5856 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642171.523705:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875527107380608:0@lo:104: 00000100:00100000:0.0:1788642171.523726:0:8532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd7bd000 going to sleep for 11 seconds 00000100:00100000:1.0:1788642171.523917:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788642171.523939:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642171.523969:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107380352 00000100:00100000:1.0:1788642171.523978:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107380352 00000100:00100000:0.0:1788642171.524005:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107380480 00000100:00100000:0.0:1788642171.524009:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107380480 00000100:00100000:0.0:1788642171.524030:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107380608 00000100:00100000:0.0:1788642171.524032:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107380608 00000100:00100000:1.0:1788642171.524037:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788642171.524303:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:8532:x1875527107380352:12345-0@lo:104: 00010000:00010000:1.0:1788642171.524321:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d079 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642171.524395:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788642171.524402:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:8532:x1875527107380352:12345-0@lo:104: Request processed in 357us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642171.526874:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875527107380352:0@lo:104: 00000100:00100000:3.0:1788642171.529136:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642171.529136:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788642171.529159:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc7081050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:8532:x1875527107380480:12345-0@lo:104: 00010000:00010000:0.0:1788642171.529194:0:7656:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cfae expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642171.529215:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875527107380224:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642171.529303:0:7656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788642171.529311:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc7081050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:8532:x1875527107380480:12345-0@lo:104: Request processed in 162us (5670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642171.529320:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788642171.529343:0:7656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788642171.529350:0:7656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef152d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:8532:x1875527107380608:12345-0@lo:104: 00010000:00010000:0.0:1788642171.529360:0:7656:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666cf5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cf61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529396:0:7656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788642171.529400:0:7656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef152d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:8532:x1875527107380608:12345-0@lo:104: Request processed in 51us (5462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642171.529405:0:7656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788642171.529461:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788642171.529469:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d079 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529477:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51400 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642171.529483:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d079 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529495:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d079 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642171.529503:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d079 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642171.529511:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788642171.529526:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf83b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875527107380480:0@lo:104: 00000100:00100000:3.0:1788642171.529536:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875527107380608:0@lo:104: 00010000:00010000:0.0:1788642171.529558:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d079 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529565:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642171.529571:0:8532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529593:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d079 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529601:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d072 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d079 expref: -99 pid: 7650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529614:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788642171.529618:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cfae expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529624:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833200 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642171.529626:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666cfae expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529639:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666cfae expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642171.529645:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666cfae expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642171.529651:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788642171.529666:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cfae expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529671:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642171.529686:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cfae expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529694:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddc9833200/0x4ae1ee156666cfa7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cfae expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529703:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642171.529706:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666cf5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666cf61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529711:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121e00 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642171.529714:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666cf5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666cf61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529720:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666cf5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666cf61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642171.529727:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666cf5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666cf61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642171.529753:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788642171.529768:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666cf5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cf61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529773:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642171.529781:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666cf5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cf61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529787:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666cf5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666cf61 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529805:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642171.529806:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642171.529808:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642171.529829:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086380672 00000100:00100000:0.0:1788642171.529836:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086380672 00010000:00010000:0.0:1788642171.529872:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d136 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9682 expref: 10 pid: 5856 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642171.529900:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:0.0:1788642171.529907:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086380672:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642171.529919:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642171.529925:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d136 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9682 expref: 10 pid: 5856 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529939:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d136 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9682 expref: 10 pid: 5856 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529955:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d136 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9682 expref: 10 pid: 5856 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.529980:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642171.530028:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+9:2359:x1875527086380672:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 122us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642171.530035:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00010000:00010000:0.0:1788642171.530053:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642171.530060:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642171.530079:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788642171.530095:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107380736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642171.530176:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642171.530238:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107380864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642171.530260:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642171.530276:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642171.530280:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107380992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642171.530297:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642171.530319:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107380736 00000100:00100000:0.0:1788642171.530322:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107380736 00010000:00010000:0.0:1788642171.530337:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666d079 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d072 expref: 19 pid: 5853 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642171.530351:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107380864 00000100:00100000:0.0:1788642171.530353:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107380864 00010000:00010000:0.0:1788642171.530362:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666cfae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cfa7 expref: 20 pid: 5853 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642171.530370:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107380992 00000100:00100000:0.0:1788642171.530372:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107380992 00010000:00010000:0.0:1788642171.530380:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddcfb50c00/0x4ae1ee156666cf61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cf5a expref: 21 pid: 5856 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642171.530404:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788642171.530409:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+21:3317:x1875527107380736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642171.530419:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642171.530423:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666d079 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d072 expref: 21 pid: 5853 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530431:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666d079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d072 expref: 21 pid: 5853 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530442:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666d079 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d072 expref: 21 pid: 5853 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530451:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642171.530478:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+20:3317:x1875527107380736:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642171.530485:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788642171.530497:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788642171.530502:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3319:x1875527107380864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642171.530510:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642171.530514:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666cfae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cfa7 expref: 19 pid: 5853 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530521:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666cfae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666cfa7 expref: 19 pid: 5853 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530530:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666cfae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666cfa7 expref: 19 pid: 5853 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530547:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642171.530571:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:3319:x1875527107380864:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642171.530577:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788642171.530590:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788642171.530595:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:3319:x1875527107380992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642171.530606:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642171.530610:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddcfb50c00/0x4ae1ee156666cf61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666cf5a expref: 17 pid: 5856 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530618:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddcfb50c00/0x4ae1ee156666cf61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666cf5a expref: 17 pid: 5856 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530627:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddcfb50c00/0x4ae1ee156666cf61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666cf5a expref: 17 pid: 5856 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530639:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530648:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530666:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530674:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530682:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530696:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530702:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833a00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642171.530707:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530716:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530729:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642171.530740:0:8532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642171.530740:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642171.530749:0:8532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642171.530756:0:8532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d1d7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642171.530762:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:3319:x1875527107380992:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642171.530768:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788642171.530901:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107380736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642171.530922:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107380992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642171.530930:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107380864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788642171.532825:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788642171.836913:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642172.570374:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642172.570552:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086380800 00000100:00100000:3.0:1788642172.570564:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086380800 00000100:00100000:3.0:1788642172.570632:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 171 00000100:00100000:3.0:1788642172.570645:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+9:5615:x1875527086380800:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788642172.570664:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642172.570690:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d1de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a96c1 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642172.570724:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d1de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96c1 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642172.570747:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d1de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96c1 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642172.570757:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6120200, rc 0) 00000100:00100000:3.0:1788642172.570826:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:5615:x1875527086380800:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 183us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642172.570833:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 171 00000100:00100000:0.0:1788642172.594634:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642172.594808:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086380928 00000100:00100000:3.0:1788642172.594841:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086380928 00000100:00100000:3.0:1788642172.594902:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 172 00000100:00100000:3.0:1788642172.594912:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+10:5615:x1875527086380928:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642172.595271:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+10:5615:x1875527086380928:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 359us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642172.595281:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 172 00000100:00100000:1.0:1788642172.613741:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642172.616831:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086381056 00000100:00100000:2.0:1788642172.616845:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086381056 00000100:00100000:2.0:1788642172.616916:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 173 00000100:00100000:2.0:1788642172.616927:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:5615:x1875527086381056:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788642172.617199:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:5615:x1875527086381056:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 272us (3468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642172.617208:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 173 00000100:00100000:1.0:1788642172.630734:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642172.632550:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086381184 00000100:00100000:0.0:1788642172.632569:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086381184 00000100:00100000:0.0:1788642172.632651:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 174 00000100:00100000:0.0:1788642172.632661:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:6147:x1875527086381184:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788642172.632962:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:6147:x1875527086381184:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 301us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642172.632982:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 174 00000100:00100000:1.0:1788642172.646453:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642172.646653:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086381312 00000100:00100000:0.0:1788642172.646668:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086381312 00000100:00100000:0.0:1788642172.646745:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 175 00000100:00100000:0.0:1788642172.646756:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+10:6147:x1875527086381312:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788642172.647040:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+10:6147:x1875527086381312:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 284us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642172.647049:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 175 00010000:00010000:0.0:1788642172.858957:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788642173.117726:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788642173.117739:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ddcc509b000 from 4 10000000:01000000:1.0:1788642173.117745:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788642173.117813:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642173.117853:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642173.117866:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642173.117894:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107381120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788642173.117974:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642173.118043:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788642173.118368:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107381120 00000100:00100000:2.0:1788642173.118378:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107381120 00000100:00100000:2.0:1788642173.118432:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788642173.118442:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107381120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642173.118459:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642173.118478:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d1ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d1e5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642173.118517:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d1ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d1e5 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642173.118531:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d1ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d1e5 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642173.118543:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f8e00, rc 0) 00000100:00100000:2.0:1788642173.118598:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107381120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642173.118605:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788642173.118736:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107381120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788642173.118757:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642173.118768:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d1ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642173.118852:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107381248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642173.118882:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642173.118915:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788642173.118999:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107381248 00000100:00100000:2.0:1788642173.119005:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107381248 00000100:00100000:2.0:1788642173.119039:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788642173.119047:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107381248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788642173.119395:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107381248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 347us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642173.119403:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788642173.120146:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107381248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642173.120190:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107381376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642173.120248:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642173.120282:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788642173.120826:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107381376 00000100:00100000:3.0:1788642173.120847:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107381376 00000100:00100000:3.0:1788642173.120900:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788642173.120912:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107381376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642173.121135:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107381376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642173.121142:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788642173.121313:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107381376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788642173.132357:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8583:1875527107381504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642173.132449:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642173.132506:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc49ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1788642173.132655:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107381504 00000100:00100000:1.0:1788642173.132669:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107381504 00000100:00100000:1.0:1788642173.133842:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788642173.133858:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:8583:x1875527107381504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788642173.134145:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:8583:x1875527107381504:12345-0@lo:502:llog_process_th.0 Request processed in 291us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642173.134153:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788642173.134995:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8583:1875527107381504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788642173.135040:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788642173.135052:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642173.135054:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788642173.135061:0:8583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ddcc509b000 00000020:00000080:2.0:1788642173.135064:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788642173.137214:0:8583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8583:1875527107381632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642173.137298:0:8583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642173.143075:0:8583:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc49edf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788642173.145008:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107381632 00000100:00100000:3.0:1788642173.145023:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107381632 00000100:00100000:3.0:1788642173.145207:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788642173.145217:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:8583:x1875527107381632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642173.145491:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:8583:x1875527107381632:12345-0@lo:502:llog_process_th.0 Request processed in 263us (8180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642173.145499:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788642173.145725:0:8583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8583:1875527107381632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788642173.145764:0:8583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642173.145772:0:8583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642173.145775:0:8583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788642173.145781:0:8583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788642173.148337:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788642173.148377:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788642173.148389:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642173.148403:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642173.148428:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788642173.148431:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddef9be800 from 4 10000000:01000000:3.0:1788642173.148433:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788642173.148472:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642173.148493:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642173.148532:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642173.148608:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107381760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788642173.148681:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642173.148718:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd91f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642173.148737:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107381760 00000100:00100000:3.0:1788642173.148744:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107381760 00000100:00100000:3.0:1788642173.148786:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788642173.148796:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107381760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788642173.148809:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642173.148823:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d1fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d1f3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642173.148848:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d1fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d1f3 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642173.148860:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d1fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d1f3 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642173.148882:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121200, rc 0) 00000100:00100000:3.0:1788642173.148922:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107381760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642173.148929:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788642173.148972:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107381760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788642173.148985:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1fa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642173.148994:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d1fa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642173.149045:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107381888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642173.149069:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642173.152958:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd91f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642173.152994:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107381888 00000100:00100000:3.0:1788642173.153003:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107381888 00000100:00100000:3.0:1788642173.153048:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788642173.153057:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107381888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642173.153461:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107381888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 403us (4389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642173.153470:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788642173.153534:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107381888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642173.153586:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107382016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642173.153631:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642173.153653:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd91f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642173.153667:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107382016 00000100:00100000:3.0:1788642173.153671:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107382016 00000100:00100000:3.0:1788642173.153689:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788642173.153695:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107382016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642173.153835:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107382016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642173.153842:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788642173.153879:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107382016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788642173.156724:0:8587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8587:1875527107382144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642173.156870:0:8587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642173.156915:0:8587:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfaaf80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642173.159781:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107382144 00000100:00100000:3.0:1788642173.159799:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107382144 00000100:00100000:3.0:1788642173.159877:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788642173.159889:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:8587:x1875527107382144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642173.160213:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:8587:x1875527107382144:12345-0@lo:502:llog_process_th.0 Request processed in 325us (3341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642173.160222:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788642173.161270:0:8587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8587:1875527107382144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788642173.161311:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642173.161323:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642173.161325:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788642173.161331:0:8587:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dddef9be800 00000020:00000080:0.0:1788642173.161334:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788642173.161837:0:8587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8587:1875527107382272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642173.161910:0:8587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642173.161947:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107382272 00000100:00100000:0.0:1788642173.161954:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107382272 00000100:00100000:0.0:1788642173.162005:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788642173.162016:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:8587:x1875527107382272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642173.162318:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:8587:x1875527107382272:12345-0@lo:502:llog_process_th.0 Request processed in 303us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642173.162326:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788642173.162389:0:8587:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfaaf80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642173.162407:0:8587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8587:1875527107382272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788642173.162437:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642173.162444:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642173.162446:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788642173.162450:0:8587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788642173.162805:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788642173.162831:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788642173.162844:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1fa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642173.162856:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1fa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642173.162866:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788642173.162868:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddc599b800 from 4 10000000:01000000:3.0:1788642173.162871:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788642173.162898:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642173.162915:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642173.162924:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642173.162941:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107382400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788642173.162975:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642173.163002:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc70380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642173.165570:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107382400 00000100:00100000:0.0:1788642173.165587:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107382400 00000100:00100000:0.0:1788642173.165646:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788642173.165656:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107382400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788642173.165673:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642173.165692:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666d208 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d201 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642173.165722:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666d208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d201 expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642173.165735:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666d208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d201 expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642173.165745:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9832a00, rc 0) 00000100:00100000:0.0:1788642173.165824:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107382400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (2848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642173.165830:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788642173.166674:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107382400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788642173.166701:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d208 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642173.166715:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d208 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642173.166801:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107382528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642173.166850:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642173.166886:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc70380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642173.173723:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107382528 00000100:00100000:0.0:1788642173.173747:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107382528 00000100:00100000:0.0:1788642173.173807:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788642173.173817:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107382528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642173.174175:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107382528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 357us (7322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642173.174184:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788642173.176756:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107382528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642173.176839:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107382656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642173.176928:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642173.176967:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc70380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642173.176992:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107382656 00000100:00100000:3.0:1788642173.176998:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107382656 00000100:00100000:3.0:1788642173.177054:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788642173.177063:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107382656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642173.177268:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107382656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642173.177276:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788642173.177328:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107382656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788642173.186280:0:8588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8588:1875527107382784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642173.186373:0:8588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642173.186425:0:8588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfaaf8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788642173.188010:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107382784 00000100:00100000:1.0:1788642173.188039:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107382784 00000100:00100000:1.0:1788642173.188170:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788642173.188186:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:8588:x1875527107382784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788642173.188615:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:8588:x1875527107382784:12345-0@lo:502:llog_process_th.0 Request processed in 433us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642173.188626:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788642173.188731:0:8588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8588:1875527107382784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788642173.188787:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788642173.188804:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642173.188807:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788642173.188818:0:8588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dddc599b800 00000020:00000080:1.0:1788642173.188821:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788642173.189423:0:8588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8588:1875527107382912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788642173.189512:0:8588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642173.189562:0:8588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e0180 going to sleep for 11 seconds 00000100:00100000:3.0:1788642173.189712:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107382912 00000100:00100000:3.0:1788642173.189728:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107382912 00000100:00100000:0.0:1788642173.195123:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788642173.195147:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:8588:x1875527107382912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642173.195497:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:8588:x1875527107382912:12345-0@lo:502:llog_process_th.0 Request processed in 359us (5984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642173.195507:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788642173.195971:0:8588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:8588:1875527107382912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788642173.196015:0:8588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642173.196032:0:8588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642173.196034:0:8588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788642173.196040:0:8588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788642173.199153:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788642173.199202:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788642173.199218:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d208 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642173.199233:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d208 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642173.882325:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642174.111015:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642174.111075:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642174.111220:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642174.111263:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642174.111301:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086381824 00000100:00100000:0.0:1788642174.111311:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086381824 00000100:00100000:0.0:1788642174.111371:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086381696 00000100:00100000:0.0:1788642174.111375:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086381696 00000100:00100000:0.0:1788642174.111398:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:0.0:1788642174.111409:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086381824:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642174.111490:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086381824:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 83us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642174.111498:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:0.0:1788642174.111516:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:0.0:1788642174.111524:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2359:x1875527086381696:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642174.111549:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2359:x1875527086381696:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642174.111556:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:2.0:1788642174.111792:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086381440 00000100:00100000:2.0:1788642174.111797:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086381440 00000100:00100000:2.0:1788642174.111837:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 191 00000100:00100000:2.0:1788642174.111845:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086381440:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642174.111881:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086381440:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 37us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642174.111887:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 191 00000100:00080000:2.0:1788642174.117270:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788642174.117281:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788642174.117608:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086381568 00000100:00100000:3.0:1788642174.117621:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086381568 00000100:00100000:3.0:1788642174.117708:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:3.0:1788642174.117719:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2360:x1875527086381568:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642174.117806:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2360:x1875527086381568:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 89us (6729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642174.117813:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00080000:2.0:1788642174.118245:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642174.651582:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788642174.651660:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788642174.651683:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107383168:0@lo:400:kworker.0 00000100:00100000:1.0:1788642174.651759:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642174.652028:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107383168 00000100:00100000:2.0:1788642174.652039:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107383168 00000100:00100000:2.0:1788642174.652132:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788642174.652142:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107383168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642174.652198:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef152a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107383168:12345-0@lo:400:kworker.0 Request processed in 58us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642174.652206:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788642174.652370:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107383168:0@lo:400:kworker.0 00000100:00100000:3.0:1788642174.660947:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107383040:0@lo:400:kworker.0 00000100:00100000:3.0:1788642174.661049:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642174.662261:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107383552:0@lo:400:kworker.0 00000100:00100000:1.0:1788642174.662310:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642174.662371:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788642174.662378:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107383680:0@lo:400:kworker.0 00000100:00100000:1.0:1788642174.662405:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642174.662554:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107383296:0@lo:400:kworker.0 00000100:00100000:0.0:1788642174.662587:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642174.662622:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642174.662627:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107383424:0@lo:400:kworker.0 00000100:00100000:0.0:1788642174.662649:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642174.662681:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107383680 00000100:00100000:0.0:1788642174.662688:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107383680 00000100:00100000:0.0:1788642174.662742:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107383424 00000100:00100000:0.0:1788642174.662745:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107383424 00000100:00100000:0.0:1788642174.662763:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788642174.662772:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107383680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642174.662843:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107383680:12345-0@lo:400:kworker.0 Request processed in 71us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642174.662859:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788642174.662876:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788642174.662882:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107383424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642174.662917:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107383424:12345-0@lo:400:kworker.0 Request processed in 35us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642174.662923:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788642174.662960:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad59880 x1875527107383424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642174.662972:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107383424:0@lo:400:kworker.0 00010000:00080000:0.0:1788642174.663002:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad59500 x1875527107383680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642174.663009:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107383680:0@lo:400:kworker.0 00000100:00100000:1.0:1788642174.663151:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107383552 00000100:00100000:1.0:1788642174.663156:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107383552 00000100:00100000:1.0:1788642174.663193:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107383296 00000100:00100000:1.0:1788642174.663196:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107383296 00000100:00100000:1.0:1788642174.663211:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788642174.663217:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107383552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642174.663255:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107383552:12345-0@lo:400:kworker.0 Request processed in 38us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642174.663261:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788642174.663272:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788642174.663277:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107383296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642174.663302:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107383296:12345-0@lo:400:kworker.0 Request processed in 26us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642174.663308:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788642174.663334:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788642174.663339:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788642174.663341:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788642174.664275:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107383296:0@lo:400:kworker.0 00000100:00100000:0.0:1788642174.664313:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107383552:0@lo:400:kworker.0 00000100:00100000:2.0:1788642174.668879:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107383040 00000100:00100000:2.0:1788642174.668896:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107383040 00000100:00100000:2.0:1788642174.669050:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788642174.669061:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107383040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642174.669295:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107383040:12345-0@lo:400:kworker.0 Request processed in 236us (8245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642174.669303:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788642174.669478:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107383040:0@lo:400:kworker.0 00010000:00010000:0.0:1788642174.906580:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642175.162504:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788642175.162535:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107383808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642175.162688:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642175.162816:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107383808 00000100:00100000:0.0:1788642175.162824:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107383808 00000100:00100000:0.0:1788642175.162885:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788642175.162896:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107383808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788642175.162943:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642175.163006:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107383808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642175.163014:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788642175.163335:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad5bb80 x1875527107383808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642175.163355:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107383808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788642175.934439:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642176.186369:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642176.186393:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107383936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642176.186480:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642176.186569:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107383936 00000100:00100000:0.0:1788642176.186577:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107383936 00000100:00100000:0.0:1788642176.186625:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788642176.186635:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107383936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788642176.186674:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642176.186721:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107383936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642176.186728:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788642176.186767:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfaf83480 x1875527107383936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642176.186797:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107383936:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788642176.186943:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788642176.960282:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642177.978626:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642179.005041:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642179.234089:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642179.234170:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642179.234204:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642179.234239:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642179.234272:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086382080 00000100:00100000:0.0:1788642179.234284:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086382080 00000100:00100000:0.0:1788642179.234351:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:0.0:1788642179.234364:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086382080:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642179.234451:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086382080:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642179.234695:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086382208 00000100:00100000:1.0:1788642179.234701:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086382208 00000100:00100000:1.0:1788642179.234746:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086382336 00000100:00100000:1.0:1788642179.234750:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086382336 00000100:00100000:1.0:1788642179.234770:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:1.0:1788642179.234792:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086382208:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642179.234837:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086382208:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 37us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642179.234844:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:1.0:1788642179.234863:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:1.0:1788642179.234869:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086382336:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642179.234894:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086382336:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 25us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642179.234901:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:3.0:1788642179.236589:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086381952 00000100:00100000:3.0:1788642179.236603:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086381952 00000100:00100000:3.0:1788642179.236668:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 193 00000100:00100000:3.0:1788642179.236678:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:2362:x1875527086381952:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642179.236736:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:2362:x1875527086381952:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 60us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642179.236743:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 193 00000100:00100000:0.0:1788642179.236895:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00080000:0.0:1788642179.236927:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642179.236932:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788642179.236935:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788642179.363990:0:8833:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1788642179.770542:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107384448:0@lo:400:kworker.0 00000100:00100000:2.0:1788642179.770635:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642179.770829:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788642179.770837:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107384320:0@lo:400:kworker.0 00000100:00100000:2.0:1788642179.770871:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642179.770915:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107384448 00000100:00100000:2.0:1788642179.770930:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107384448 00000100:00100000:2.0:1788642179.770997:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788642179.771006:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107384448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642179.771056:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107384448:12345-0@lo:400:kworker.0 Request processed in 52us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642179.771061:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788642179.771078:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107384320 00000100:00100000:2.0:1788642179.771081:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107384320 00000100:00100000:2.0:1788642179.771121:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788642179.771126:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107384320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642179.771146:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107384320:12345-0@lo:400:kworker.0 Request processed in 20us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642179.771150:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788642179.771162:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788642179.771167:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788642179.771202:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107384320:0@lo:400:kworker.0 00010000:00080000:2.0:1788642179.771217:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef9efb80 x1875527107384448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642179.771456:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107384192:0@lo:400:kworker.0 00000100:00100000:3.0:1788642179.771492:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642179.771591:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107384064:0@lo:400:kworker.0 00000100:00100000:0.0:1788642179.771636:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642179.771679:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107384576:0@lo:400:kworker.0 00000100:00100000:2.0:1788642179.771830:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107384448:0@lo:400:kworker.0 00000100:00100000:3.0:1788642179.772032:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107384704:0@lo:400:kworker.0 00000100:00100000:3.0:1788642179.772063:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642179.772177:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107384064 00000100:00100000:0.0:1788642179.772184:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107384064 00000100:00100000:0.0:1788642179.772220:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788642179.772238:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107384064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642179.772275:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107384064:12345-0@lo:400:kworker.0 Request processed in 49us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642179.772282:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788642179.772309:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642179.772350:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107384704 00000100:00100000:2.0:1788642179.772367:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107384704 00000100:00100000:2.0:1788642179.772403:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788642179.772409:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107384704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642179.772444:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107384704:12345-0@lo:400:kworker.0 Request processed in 35us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642179.772451:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788642179.772465:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788642179.777257:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef9ee300 x1875527107384704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642179.777280:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107384704:0@lo:400:kworker.0 00000100:00100000:0.0:1788642179.779214:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107384064:0@lo:400:kworker.0 00000100:00100000:2.0:1788642179.779347:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107384192 00000100:00100000:2.0:1788642179.779354:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107384192 00000100:00100000:2.0:1788642179.779400:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107384576 00000100:00100000:2.0:1788642179.779404:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107384576 00000100:00100000:2.0:1788642179.779445:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788642179.779454:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107384192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642179.779520:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107384192:12345-0@lo:400:kworker.0 Request processed in 68us (8027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642179.779526:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788642179.779538:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788642179.779541:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107384576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642179.779572:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107384576:12345-0@lo:400:kworker.0 Request processed in 30us (7261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642179.779578:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788642179.779618:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107384576:0@lo:400:kworker.0 00000100:00100000:2.0:1788642179.779642:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107384192:0@lo:400:kworker.0 00000100:00080000:3.0:1788642179.779848:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788642180.029403:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642180.283184:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788642180.283219:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107384832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642180.283343:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642180.283426:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107384832 00000100:00100000:1.0:1788642180.283438:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107384832 00000100:00100000:1.0:1788642180.283508:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788642180.283520:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107384832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642180.283571:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642180.283628:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107384832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642180.283636:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788642180.284130:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad5a680 x1875527107384832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642180.284153:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107384832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788642181.052052:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642181.307815:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642181.307841:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107384960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788642181.307940:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642181.308119:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107384960 00000100:00100000:0.0:1788642181.308128:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107384960 00000100:00100000:0.0:1788642181.308195:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788642181.308205:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107384960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788642181.308240:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642181.308292:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107384960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642181.308299:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788642181.308368:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf0700 x1875527107384960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642181.308388:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107384960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788642181.308550:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788642182.074349:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642183.098633:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642184.122231:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642184.368499:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642184.368556:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642184.368602:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642184.368630:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642184.368664:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086382720 00000100:00100000:1.0:1788642184.368687:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086382720 00000100:00100000:1.0:1788642184.368752:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086382848 00000100:00100000:1.0:1788642184.368755:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086382848 00000100:00100000:1.0:1788642184.368779:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788642184.368790:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2358:x1875527086382720:12345-192.168.202.49@tcp:9:kworker.0 00000020:00000080:1.0:1788642184.368829:0:6709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d144 00000100:00080000:1.0:1788642184.368841:0:6709:0:(import.c:65:import_set_state_nolock()) ffff8ddcc65cd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788642184.368886:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788642184.369610:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+2:2358:x1875527086382720:12345-192.168.202.49@tcp:9:kworker.0 Request processed in 818us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642184.369620:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788642184.369642:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788642184.369651:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2358:x1875527086382848:12345-192.168.202.49@tcp:9:kworker.0 00000020:00000080:1.0:1788642184.369671:0:6709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d14b 00000100:00080000:1.0:1788642184.369681:0:6709:0:(import.c:65:import_set_state_nolock()) ffff8ddcc65cf000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788642184.369703:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788642184.369904:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+2:2358:x1875527086382848:12345-192.168.202.49@tcp:9:kworker.0 Request processed in 253us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642184.369911:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00080000:1.0:1788642184.369941:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788642184.370899:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642184.371136:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086382464 00000100:00100000:3.0:1788642184.371146:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086382464 00000100:00100000:3.0:1788642184.371196:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 195 00000100:00100000:3.0:1788642184.371205:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086382464:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642184.371267:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086382464:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 63us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642184.371274:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 195 00010000:00010000:3.0:1788642184.371322:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642184.371443:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642184.371712:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086382592 00000100:00100000:2.0:1788642184.371718:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086382592 00000100:00100000:2.0:1788642184.371766:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:2.0:1788642184.371774:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2360:x1875527086382592:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642184.371818:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2360:x1875527086382592:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 45us (3261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642184.371825:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00080000:3.0:1788642184.372044:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642184.891335:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107385344:0@lo:400:kworker.0 00000100:00100000:1.0:1788642184.891425:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642184.891489:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642184.891496:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107385472:0@lo:400:kworker.0 00000100:00100000:1.0:1788642184.891522:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642184.891566:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107385344 00000100:00100000:1.0:1788642184.891586:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107385344 00000100:00100000:1.0:1788642184.891652:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788642184.891662:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107385344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642184.891723:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107385344:12345-0@lo:400:kworker.0 Request processed in 60us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642184.891732:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788642184.891755:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107385472 00000100:00100000:1.0:1788642184.891759:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107385472 00000100:00100000:1.0:1788642184.891785:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788642184.891791:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107385472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642184.891820:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107385472:12345-0@lo:400:kworker.0 Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642184.891825:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788642184.891864:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad5b800 x1875527107385472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642184.891877:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107385472:0@lo:400:kworker.0 00000100:00100000:1.0:1788642184.891887:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107385344:0@lo:400:kworker.0 00000100:00100000:3.0:1788642184.891982:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107385216:0@lo:400:kworker.0 00000100:00100000:3.0:1788642184.892013:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642184.892044:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107385728:0@lo:400:kworker.0 00000100:00100000:3.0:1788642184.892073:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642184.892129:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788642184.892136:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107385088:0@lo:400:kworker.0 00000100:00100000:3.0:1788642184.892163:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642184.892185:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107385600:0@lo:400:kworker.0 00000100:00100000:3.0:1788642184.892204:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788642184.892228:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788642184.892234:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642184.892246:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107385728 00000100:00100000:3.0:1788642184.892250:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107385728 00000100:00100000:3.0:1788642184.892282:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788642184.892289:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107385728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642184.892324:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107385728:12345-0@lo:400:kworker.0 Request processed in 36us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642184.892329:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788642184.892346:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107385088 00000100:00100000:3.0:1788642184.892349:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107385088 00000100:00100000:3.0:1788642184.892385:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788642184.892392:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107385088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642184.892421:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107385088:12345-0@lo:400:kworker.0 Request processed in 30us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642184.892439:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1788642184.892468:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788642184.892477:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107385216 00000100:00100000:3.0:1788642184.892480:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107385216 00000100:00100000:3.0:1788642184.892503:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107385600 00000100:00100000:3.0:1788642184.892505:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107385600 00000100:00100000:3.0:1788642184.892524:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788642184.892530:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107385216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642184.892560:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107385216:12345-0@lo:400:kworker.0 Request processed in 30us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642184.892567:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788642184.892578:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788642184.892584:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107385600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642184.892610:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107385600:12345-0@lo:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642184.892616:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788642184.892634:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642184.892652:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107385088:0@lo:400:kworker.0 00000100:00100000:3.0:1788642184.892663:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107385600:0@lo:400:kworker.0 00000100:00100000:3.0:1788642184.892672:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107385216:0@lo:400:kworker.0 00010000:00080000:3.0:1788642184.892682:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad5ad80 x1875527107385728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642184.892693:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107385728:0@lo:400:kworker.0 00010000:00010000:0.0:1788642185.156545:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788642185.264607:0:9077:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing yml_node 00000100:00100000:2.0:1788642185.404215:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107385856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642185.404287:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642185.404416:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107385856 00000100:00100000:0.0:1788642185.404425:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107385856 00000100:00100000:0.0:1788642185.404477:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788642185.404488:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107385856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788642185.404532:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642185.404589:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107385856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642185.404597:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788642185.404643:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef17d500 x1875527107385856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642185.404664:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107385856:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788642186.172470:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642186.427505:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642186.427534:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107385984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788642186.427623:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642186.427719:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107385984 00000100:00100000:1.0:1788642186.427729:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107385984 00000100:00100000:1.0:1788642186.427807:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788642186.427815:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107385984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788642186.427862:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642186.427927:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107385984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642186.427935:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788642186.427959:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788642186.427995:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad5b100 x1875527107385984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642186.428016:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107385984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788642187.196892:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788642188.070291:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000020:00000080:3.0:1788642188.070303:0:6736:0:(genops.c:885:class_export_put()) final put ffff8ddcc65cb800/e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000020:00000080:2.0:1788642188.070390:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc65cb800/e32b659c-dd8d-40c5-94b4-b9b0e719a356 for lustre-OST0000 00000020:00000080:2.0:1788642188.070455:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ddcc65cd800 for lustre-OST0000 00010000:00010000:0.0:1788642188.219898:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788642188.505071:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000020:00000080:0.0:1788642188.505088:0:7669:0:(genops.c:885:class_export_put()) final put ffff8ddcc65c9000/e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000020:00000080:1.0:1788642188.505192:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc65c9000/e32b659c-dd8d-40c5-94b4-b9b0e719a356 for lustre-OST0001 00000020:00000080:1.0:1788642188.505834:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ddcc65cf000 for lustre-OST0001 00010000:00010000:3.0:1788642189.250219:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642189.466575:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642189.466709:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086383104 00000100:00100000:3.0:1788642189.466718:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086383104 00000100:00100000:3.0:1788642189.466877:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:3.0:1788642189.466888:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086383104:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642189.466963:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086383104:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 77us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642189.466971:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00080000:1.0:1788642189.467126:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642189.475128:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642189.475171:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086382976 00000100:00100000:1.0:1788642189.475182:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086382976 00000100:00100000:1.0:1788642189.475239:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 197 00000100:00100000:1.0:1788642189.475250:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:2362:x1875527086382976:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642189.476509:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:2362:x1875527086382976:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 1250us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642189.476535:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 197 00000001:02000400:1.0:1788642189.712646:0:9271:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.3 00000100:00100000:2.0:1788642190.010336:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107386112:0@lo:400:kworker.0 00000100:00100000:2.0:1788642190.010426:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642190.010613:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107386112 00000100:00100000:3.0:1788642190.010623:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107386112 00000100:00100000:3.0:1788642190.010685:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788642190.010694:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107386112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642190.010839:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107386240:0@lo:400:kworker.0 00000100:00100000:0.0:1788642190.010874:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642190.010920:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107386240 00000100:00100000:0.0:1788642190.010936:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107386240 00000100:00100000:0.0:1788642190.010967:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788642190.010985:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107386240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642190.011022:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107386240:12345-0@lo:400:kworker.0 Request processed in 37us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642190.011041:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788642190.011087:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107386240:0@lo:400:kworker.0 00000100:00100000:3.0:1788642190.013873:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107386112:12345-0@lo:400:kworker.0 Request processed in 3168us (3434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642190.013892:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788642190.017125:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107386752:0@lo:400:kworker.0 00000100:00100000:1.0:1788642190.017208:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642190.017246:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788642190.017252:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107386624:0@lo:400:kworker.0 00000100:00100000:1.0:1788642190.017277:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642190.017664:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107386752 00000100:00100000:1.0:1788642190.017687:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107386752 00000100:00100000:1.0:1788642190.017757:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788642190.017848:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788642190.017885:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107386752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642190.018005:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107386752:12345-0@lo:400:kworker.0 Request processed in 240us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642190.018013:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788642190.018036:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107386624 00000100:00100000:1.0:1788642190.018040:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107386624 00000100:00100000:1.0:1788642190.018070:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788642190.018077:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107386624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642190.018130:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107386624:12345-0@lo:400:kworker.0 Request processed in 54us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642190.018147:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788642190.018165:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642190.018465:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107386368:0@lo:400:kworker.0 00000100:00100000:3.0:1788642190.018496:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642190.018527:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642190.018533:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107386496:0@lo:400:kworker.0 00000100:00100000:3.0:1788642190.018554:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642190.018572:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107386496 00000100:00100000:3.0:1788642190.018575:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107386496 00000100:00100000:3.0:1788642190.018593:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788642190.018597:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107386496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642190.018620:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107386496:12345-0@lo:400:kworker.0 Request processed in 23us (65us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642190.018630:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788642190.018654:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad59880 x1875527107386496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642190.018664:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107386496:0@lo:400:kworker.0 00010000:00080000:0.0:1788642190.019216:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad5ad80 x1875527107386752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642190.019228:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107386752:0@lo:400:kworker.0 00000100:00100000:0.0:1788642190.019250:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107386624:0@lo:400:kworker.0 00000100:00100000:1.0:1788642190.019281:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107386368 00000100:00100000:2.0:1788642190.019330:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107386112:0@lo:400:kworker.0 00000100:00100000:1.0:1788642190.019355:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107386368 00000100:00100000:1.0:1788642190.019460:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788642190.019466:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107386368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642190.020914:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107386368:12345-0@lo:400:kworker.0 Request processed in 1438us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642190.020938:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788642190.020939:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788642190.020956:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642190.022280:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107386368:0@lo:400:kworker.0 00010000:00010000:3.0:1788642190.267190:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642190.523037:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788642190.523077:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107386880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642190.523636:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642190.523864:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107386880 00000100:00100000:1.0:1788642190.523875:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107386880 00000100:00100000:1.0:1788642190.524269:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788642190.524282:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107386880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642190.524417:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642190.524484:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107386880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 205us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642190.524507:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788642190.524720:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf3b80 x1875527107386880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642190.524756:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107386880:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788642191.290376:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642191.546457:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107387008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642191.548133:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642191.548300:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107387008 00000100:00100000:0.0:1788642191.548311:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107387008 00000100:00100000:0.0:1788642191.548363:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788642191.548373:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107387008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788642191.548412:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642191.549062:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107387008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 687us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642191.549072:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788642191.549324:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad59f80 x1875527107387008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642191.549346:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107387008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788642192.317746:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788642192.694418:0:9369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.3 00010000:00010000:0.0:1788642193.338714:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642194.362647:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642194.590392:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642194.590603:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642194.593165:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086383360 00000100:00100000:3.0:1788642194.593189:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086383360 00000100:00100000:3.0:1788642194.593319:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:3.0:1788642194.593334:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086383360:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642194.593501:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086383360:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 155us (2882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642194.593511:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00080000:0.0:1788642194.594156:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642194.595611:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086383232 00000100:00100000:1.0:1788642194.595634:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086383232 00000100:00100000:1.0:1788642194.597187:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 199 00000100:00100000:1.0:1788642194.597203:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086383232:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642194.597336:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086383232:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 137us (6963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642194.597344:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 199 00000100:00100000:1.0:1788642195.131434:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107387392:0@lo:400:kworker.0 00000100:00100000:2.0:1788642195.131627:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107387136:0@lo:400:kworker.0 00000100:00100000:2.0:1788642195.131723:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642195.131806:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107387648:0@lo:400:kworker.0 00000100:00100000:2.0:1788642195.131840:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642195.131881:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788642195.131887:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107387264:0@lo:400:kworker.0 00000100:00100000:1.0:1788642195.131954:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642195.131971:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107387520:0@lo:400:kworker.0 00000100:00100000:1.0:1788642195.132024:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107387648 00000100:00100000:2.0:1788642195.132026:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642195.132040:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107387648 00000100:00100000:2.0:1788642195.132087:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107387392 00000100:00100000:2.0:1788642195.132092:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107387392 00000100:00100000:2.0:1788642195.132175:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788642195.132187:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107387392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642195.132218:0:5862:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788642195.132234:0:5862:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788642195.132264:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107387520 00000100:00100000:1.0:1788642195.132269:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107387520 00000100:00100000:2.0:1788642195.132270:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107387392:12345-0@lo:400:kworker.0 Request processed in 83us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642195.132282:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788642195.132305:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788642195.132313:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107387648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642195.132319:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788642195.132331:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107387520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642195.132349:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107387648:12345-0@lo:400:kworker.0 Request processed in 37us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642195.132355:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788642195.132384:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788642195.132391:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642195.132401:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642195.132797:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107387776:0@lo:400:kworker.0 00000100:00100000:2.0:1788642195.132831:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642195.132880:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107387648:0@lo:400:kworker.0 00000100:00100000:2.0:1788642195.132943:0:6711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788642195.132951:0:6711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788642195.132961:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107387264 00000100:00100000:2.0:1788642195.132964:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107387264 00000100:00100000:2.0:1788642195.133510:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788642195.133523:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107387264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642195.133583:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107387264:12345-0@lo:400:kworker.0 Request processed in 65us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642195.133591:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788642195.133643:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107387264:0@lo:400:kworker.0 00000100:00100000:0.0:1788642195.134027:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107387136 00000100:00100000:0.0:1788642195.134035:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107387136 00000100:00100000:0.0:1788642195.134078:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788642195.134120:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107387136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642195.134179:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107387136:12345-0@lo:400:kworker.0 Request processed in 82us (2457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642195.134186:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788642195.134247:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107387136:0@lo:400:kworker.0 00000100:00100000:2.0:1788642195.135198:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107387776 00000100:00100000:2.0:1788642195.135210:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107387776 00000100:00100000:2.0:1788642195.135269:0:6711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788642195.135282:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788642195.135291:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107387776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642195.135378:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107387776:12345-0@lo:400:kworker.0 Request processed in 89us (2546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642195.135385:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788642195.135407:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788642195.135553:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107387392:0@lo:400:kworker.0 00010000:00080000:0.0:1788642195.136141:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad59880 x1875527107387776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642195.136158:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107387776:0@lo:400:kworker.0 00000100:00100000:1.0:1788642195.137670:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107387520:12345-0@lo:400:kworker.0 Request processed in 5328us (5629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642195.137691:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788642195.137772:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad58000 x1875527107387520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642195.137789:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107387520:0@lo:400:kworker.0 00010000:00010000:3.0:1788642195.387064:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642195.643270:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107387904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642195.643370:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642195.643412:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107387904 00000100:00100000:0.0:1788642195.643423:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107387904 00000100:00100000:0.0:1788642195.643598:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788642195.643611:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107387904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788642195.643662:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642195.643746:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107387904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642195.643755:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788642195.644191:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf3b80 x1875527107387904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642195.644221:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107387904:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788642195.724848:0:9468:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.3 00010000:00010000:0.0:1788642196.410312:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642196.666800:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107388032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642196.666960:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642196.667184:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107388032 00000100:00100000:3.0:1788642196.667199:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107388032 00000100:00100000:3.0:1788642196.667300:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788642196.667313:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107388032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642196.667390:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642196.667464:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107388032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642196.667473:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788642196.667853:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc5dce680 x1875527107388032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642196.667941:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107388032:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788642197.396874:0:9516:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 17:03:15 EDT 2026 00010000:00010000:1.0:1788642197.437286:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642198.461793:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642199.482758:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642199.718772:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642199.718830:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642199.718881:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086383616 00000100:00100000:3.0:1788642199.718896:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086383616 00000100:00100000:3.0:1788642199.718986:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:3.0:1788642199.718999:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086383616:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642199.719123:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086383616:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 127us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642199.719132:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00080000:3.0:1788642199.719155:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642199.719709:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086383488 00000100:00100000:2.0:1788642199.719717:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086383488 00000100:00100000:2.0:1788642199.719752:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 201 00000100:00100000:2.0:1788642199.719759:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086383488:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642199.719798:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086383488:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 39us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642199.719804:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 201 00000100:00100000:1.0:1788642200.250443:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107388416:0@lo:400:kworker.0 00000100:00100000:1.0:1788642200.250516:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642200.250581:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642200.250588:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107388544:0@lo:400:kworker.0 00000100:00100000:1.0:1788642200.250659:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642200.250957:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107388288:0@lo:400:kworker.0 00000100:00100000:3.0:1788642200.250988:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642200.251012:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107388800:0@lo:400:kworker.0 00000100:00100000:3.0:1788642200.251033:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642200.251044:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107388160:0@lo:400:kworker.0 00000100:00100000:0.0:1788642200.251091:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642200.251130:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107388672:0@lo:400:kworker.0 00000100:00100000:3.0:1788642200.251139:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107388544 00000100:00100000:3.0:1788642200.251146:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107388544 00000100:00100000:0.0:1788642200.251165:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642200.251192:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107388800 00000100:00100000:0.0:1788642200.251194:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107388416 00000100:00100000:3.0:1788642200.251195:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107388800 00000100:00100000:0.0:1788642200.251197:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107388416 00000100:00100000:3.0:1788642200.251217:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788642200.251220:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107388288 00000100:00100000:0.0:1788642200.251222:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107388288 00000100:00100000:3.0:1788642200.251225:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107388544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642200.251232:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107388672 00000100:00100000:0.0:1788642200.251234:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107388672 00000100:00100000:0.0:1788642200.251245:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788642200.251251:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107388416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642200.251272:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107388544:12345-0@lo:400:kworker.0 Request processed in 48us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642200.251277:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107388416:12345-0@lo:400:kworker.0 Request processed in 27us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642200.251284:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788642200.251285:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788642200.251301:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788642200.251306:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107388288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642200.251336:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107388288:12345-0@lo:400:kworker.0 Request processed in 30us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642200.251342:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788642200.251361:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788642200.251367:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107388672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642200.251398:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107388672:12345-0@lo:400:kworker.0 Request processed in 31us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642200.251409:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788642200.251447:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107388160 00000100:00100000:0.0:1788642200.251451:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107388160 00000100:00100000:1.0:1788642200.251461:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788642200.251469:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107388800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642200.251474:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788642200.251479:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107388160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642200.251500:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107388800:12345-0@lo:400:kworker.0 Request processed in 33us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642200.251502:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107388160:12345-0@lo:400:kworker.0 Request processed in 24us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642200.251507:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788642200.251508:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788642200.251545:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107388160:0@lo:400:kworker.0 00000100:00100000:0.0:1788642200.251567:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107388672:0@lo:400:kworker.0 00000100:00080000:3.0:1788642200.251693:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788642200.251764:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788642200.251766:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642200.251801:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107388288:0@lo:400:kworker.0 00010000:00080000:3.0:1788642200.251815:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc5dcdf80 x1875527107388800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642200.251823:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107388800:0@lo:400:kworker.0 00010000:00080000:3.0:1788642200.251846:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc5dcc380 x1875527107388544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642200.251854:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107388544:0@lo:400:kworker.0 00000100:00100000:3.0:1788642200.251863:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107388416:0@lo:400:kworker.0 00010000:00010000:1.0:1788642200.507230:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642200.762599:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107388928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642200.762689:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642200.762989:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107388928 00000100:00100000:2.0:1788642200.762998:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107388928 00000100:00100000:2.0:1788642200.763058:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788642200.763078:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107388928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788642200.763160:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642200.763208:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107388928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642200.763215:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788642200.763525:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc7397b80 x1875527107388928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642200.763546:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107388928:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788642201.532909:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642201.787524:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642201.787563:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107389056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642201.787660:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642201.787755:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107389056 00000100:00100000:0.0:1788642201.787764:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107389056 00000100:00100000:0.0:1788642201.787826:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788642201.787836:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107389056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788642201.787901:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642201.787960:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107389056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642201.787969:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788642201.788018:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc7396680 x1875527107389056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642201.788041:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107389056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788642202.554651:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642203.580580:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642204.603275:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642204.832083:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642204.832232:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642204.832935:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086383872 00000100:00100000:0.0:1788642204.832952:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086383872 00000100:00100000:0.0:1788642204.833224:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:0.0:1788642204.833242:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086383872:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642204.833349:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086383872:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 112us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642204.833359:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00080000:3.0:1788642204.833839:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642204.833964:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086383744 00000100:00100000:2.0:1788642204.833971:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086383744 00000100:00100000:2.0:1788642204.834046:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 203 00000100:00100000:2.0:1788642204.834054:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086383744:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642204.834148:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+10:2359:x1875527086383744:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 91us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642204.834157:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 203 00000100:00100000:2.0:1788642205.372328:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107389440:0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.372415:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642205.372482:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788642205.372489:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107389568:0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.372516:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642205.372559:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107389440 00000100:00100000:2.0:1788642205.372567:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107389440 00000100:00100000:2.0:1788642205.372625:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788642205.372634:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107389440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.372684:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107389440:12345-0@lo:400:kworker.0 Request processed in 51us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642205.372691:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788642205.372715:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107389568 00000100:00100000:2.0:1788642205.372718:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107389568 00000100:00100000:2.0:1788642205.372793:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788642205.372800:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107389568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.372831:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107389568:12345-0@lo:400:kworker.0 Request processed in 32us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642205.372838:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788642205.372853:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788642205.372858:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788642205.372889:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad59880 x1875527107389568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642205.372903:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107389568:0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.372915:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107389440:0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.372958:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107389312:0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.372981:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642205.373000:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107389824:0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.373041:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642205.373079:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788642205.373084:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107389184:0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.373145:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642205.373167:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107389696:0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.373195:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642205.373217:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107389312 00000100:00100000:2.0:1788642205.373220:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107389312 00000100:00100000:2.0:1788642205.373235:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107389696 00000100:00100000:2.0:1788642205.373237:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107389696 00000100:00100000:2.0:1788642205.373250:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788642205.373255:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107389312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.373290:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107389312:12345-0@lo:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642205.373296:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788642205.373308:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788642205.373314:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107389696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.373336:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107389696:12345-0@lo:400:kworker.0 Request processed in 24us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642205.373340:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788642205.373354:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107389824 00000100:00100000:2.0:1788642205.373356:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107389824 00000100:00100000:2.0:1788642205.373372:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788642205.373375:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107389824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.373392:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107389824:12345-0@lo:400:kworker.0 Request processed in 17us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642205.373396:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788642205.373413:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107389184 00000100:00100000:2.0:1788642205.373416:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107389184 00000100:00100000:2.0:1788642205.373430:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788642205.373433:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107389184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.373452:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107389184:12345-0@lo:400:kworker.0 Request processed in 19us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642205.373456:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1788642205.373476:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788642205.373478:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642205.373490:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107389184:0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.373496:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107389696:0@lo:400:kworker.0 00000100:00100000:2.0:1788642205.373500:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107389312:0@lo:400:kworker.0 00010000:00080000:2.0:1788642205.373506:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad59f80 x1875527107389824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642205.373512:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107389824:0@lo:400:kworker.0 00010000:00010000:0.0:1788642205.626282:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642205.882460:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107389952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642205.882559:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642205.882861:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107389952 00000100:00100000:3.0:1788642205.882874:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107389952 00000100:00100000:3.0:1788642205.882947:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788642205.882958:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107389952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642205.883027:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642205.883081:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107389952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642205.883089:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788642205.883288:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc64f0380 x1875527107389952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642205.883307:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107389952:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788642206.651440:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642206.907053:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107390080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788642206.907158:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642206.907559:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107390080 00000100:00100000:0.0:1788642206.907567:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107390080 00000100:00100000:0.0:1788642206.907622:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788642206.907631:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107390080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788642206.907733:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642206.907783:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107390080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642206.907791:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788642206.909851:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc7396680 x1875527107390080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642206.909895:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107390080:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788642207.678564:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642208.701849:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642209.722358:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642209.944637:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642209.944695:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642209.944973:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086384128 00000100:00100000:2.0:1788642209.944999:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086384128 00000100:00100000:2.0:1788642209.945082:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:2.0:1788642209.945093:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086384128:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642209.945213:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086384128:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 121us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642209.945220:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00080000:2.0:1788642209.945240:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642209.945304:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086384000 00000100:00100000:3.0:1788642209.945310:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086384000 00000100:00100000:3.0:1788642209.945353:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 205 00000100:00100000:3.0:1788642209.945361:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:2361:x1875527086384000:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642209.945407:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+10:2361:x1875527086384000:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 47us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642209.945415:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 205 00000100:00100000:0.0:1788642210.501237:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107390208:0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.501320:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642210.501367:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107390720:0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.501392:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642210.501416:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788642210.501422:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107390336:0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.501440:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642210.501473:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107390848:0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.501495:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642210.501937:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107390464:0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.501990:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642210.502019:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642210.502024:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107390592:0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.502048:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642210.502084:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107390208 00000100:00100000:0.0:1788642210.502092:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107390208 00000100:00100000:0.0:1788642210.502171:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788642210.502180:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107390208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.502231:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107390208:12345-0@lo:400:kworker.0 Request processed in 52us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642210.502238:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788642210.502267:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107390720 00000100:00100000:0.0:1788642210.502270:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107390720 00000100:00100000:0.0:1788642210.502301:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107390336 00000100:00100000:0.0:1788642210.502304:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107390336 00000100:00100000:0.0:1788642210.502316:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107390464 00000100:00100000:0.0:1788642210.502319:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107390464 00000100:00100000:0.0:1788642210.502331:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788642210.502337:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107390720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.502369:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107390720:12345-0@lo:400:kworker.0 Request processed in 32us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642210.502374:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788642210.502386:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788642210.502391:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107390336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.502432:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107390336:12345-0@lo:400:kworker.0 Request processed in 41us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642210.502438:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788642210.502450:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788642210.502455:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107390464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.502483:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107390464:12345-0@lo:400:kworker.0 Request processed in 28us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642210.502488:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788642210.502511:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107390848 00000100:00100000:0.0:1788642210.502514:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107390848 00000100:00100000:0.0:1788642210.504753:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107390592 00000100:00100000:0.0:1788642210.504765:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107390592 00000100:00100000:0.0:1788642210.504799:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788642210.504809:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107390848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.504888:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107390848:12345-0@lo:400:kworker.0 Request processed in 80us (3391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642210.504895:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788642210.504909:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788642210.504916:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107390592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.504960:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107390592:12345-0@lo:400:kworker.0 Request processed in 33us (2898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642210.504967:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788642210.504999:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788642210.505004:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642210.505007:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788642210.505052:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc7395f80 x1875527107390592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642210.505087:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107390592:0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.505129:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107390464:0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.505168:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107390336:0@lo:400:kworker.0 00010000:00080000:0.0:1788642210.505180:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc7397100 x1875527107390848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642210.505190:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107390848:0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.505201:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107390208:0@lo:400:kworker.0 00000100:00100000:0.0:1788642210.505213:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107390720:0@lo:400:kworker.0 00010000:00010000:2.0:1788642210.748066:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642211.002362:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788642211.002388:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107390976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642211.002466:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642211.002555:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107390976 00000100:00100000:3.0:1788642211.002566:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107390976 00000100:00100000:3.0:1788642211.002618:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788642211.002627:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107390976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642211.002667:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642211.002716:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107390976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642211.002724:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788642211.002774:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc4e36680 x1875527107390976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642211.002791:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107390976:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788642211.770324:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642212.026625:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788642212.026657:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107391104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788642212.026734:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642212.026884:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107391104 00000100:00100000:0.0:1788642212.026893:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107391104 00000100:00100000:0.0:1788642212.026971:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788642212.026981:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107391104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788642212.027018:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642212.027068:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107391104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642212.027075:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788642212.027144:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc7394a80 x1875527107391104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642212.027166:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107391104:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788642212.027916:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788642212.794443:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788642213.645500:0:10148:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 17:03:32 (1788642212) === 00010000:00010000:2.0:1788642213.827769:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642214.042061:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642214.042837:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086384256 00000100:00100000:2.0:1788642214.042852:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086384256 00000100:00100000:2.0:1788642214.042926:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 207 00000100:00100000:2.0:1788642214.042936:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+10:8148:x1875527086384256:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788642214.042965:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642214.042985:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e0200/0x4ae1ee156666d20f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a96c8 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642214.043018:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e0200/0x4ae1ee156666d20f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96c8 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642214.043055:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e0200/0x4ae1ee156666d20f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96c8 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642214.043066:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0200, rc 0) 00000100:00100000:2.0:1788642214.043155:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+11:8148:x1875527086384256:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 220us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642214.043162:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 207 00000100:00100000:1.0:1788642214.048282:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642214.048383:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086384384 00000100:00100000:3.0:1788642214.048395:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086384384 00000100:00100000:3.0:1788642214.048456:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 208 00000100:00100000:3.0:1788642214.048469:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+11:8148:x1875527086384384:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788642214.049230:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+11:8148:x1875527086384384:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 758us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642214.049241:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 208 00000100:00100000:1.0:1788642214.051367:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642214.052921:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086384512 00000100:00100000:2.0:1788642214.052955:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086384512 00000100:00100000:2.0:1788642214.053051:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 209 00000100:00100000:2.0:1788642214.053239:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+11:8148:x1875527086384512:12345-192.168.202.49@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788642214.053971:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+11:8148:x1875527086384512:12345-192.168.202.49@tcp:503:mount.lustre.0 Request processed in 732us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642214.053983:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 209 00000100:00100000:1.0:1788642214.085260:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642214.085376:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086384640 00000100:00100000:0.0:1788642214.085410:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086384640 00000100:00100000:0.0:1788642214.085487:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 210 00000100:00100000:0.0:1788642214.085501:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+11:8152:x1875527086384640:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788642214.087207:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+11:8152:x1875527086384640:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 388us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642214.087234:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 210 00000100:00100000:1.0:1788642214.115165:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642214.115289:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086384768 00000100:00100000:2.0:1788642214.115305:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086384768 00000100:00100000:2.0:1788642214.115387:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 211 00000100:00100000:2.0:1788642214.115400:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+11:8152:x1875527086384768:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788642214.115848:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+11:8152:x1875527086384768:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 448us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642214.115857:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 211 00000100:00100000:1.0:1788642214.122866:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642214.122965:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086384896 00000100:00100000:0.0:1788642214.122979:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086384896 00000100:00100000:0.0:1788642214.123170:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 212 00000100:00100000:0.0:1788642214.123184:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+11:8148:x1875527086384896:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788642214.123208:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642214.123235:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d216 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a96f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642214.123273:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96f2 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642214.123287:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96f2 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642214.123298:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833a00, rc 0) 00000100:00100000:0.0:1788642214.123375:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+12:8148:x1875527086384896:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 194us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642214.123384:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 212 00000100:00100000:1.0:1788642214.127069:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642214.127215:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086385024 00000100:00100000:3.0:1788642214.127230:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086385024 00000100:00100000:3.0:1788642214.127349:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 213 00000100:00100000:3.0:1788642214.127362:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+12:8148:x1875527086385024:12345-192.168.202.49@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788642214.127398:0:5854:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788642214.127432:0:5854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788642214.127437:0:5854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788642214.127440:0:5854:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788642214.127442:0:5854:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788642214.130644:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+12:8148:x1875527086385024:12345-192.168.202.49@tcp:256:mount.lustre.0 Request processed in 3266us (3583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642214.130666:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 213 00000100:00100000:1.0:1788642214.134371:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642214.134486:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086385152 00000100:00100000:0.0:1788642214.134500:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086385152 00000100:00100000:0.0:1788642214.134618:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 214 00000100:00100000:0.0:1788642214.134630:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+12:8148:x1875527086385152:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788642214.134673:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642214.134697:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d21d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a96f9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642214.134745:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d21d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96f9 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642214.134758:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d21d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96f9 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642214.134775:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833c00, rc 0) 00000100:00100000:0.0:1788642214.134852:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:8148:x1875527086385152:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 224us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642214.134859:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 214 00000100:00100000:1.0:1788642214.138618:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642214.139140:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086385280 00000100:00100000:3.0:1788642214.139154:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086385280 00000100:00100000:3.0:1788642214.139237:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 215 00000100:00100000:3.0:1788642214.139271:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:8148:x1875527086385280:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788642214.139755:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:8148:x1875527086385280:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 486us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642214.139766:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 215 00000100:00100000:1.0:1788642214.146795:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642214.146992:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086385408 00000100:00100000:0.0:1788642214.147009:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086385408 00000100:00100000:3.0:1788642214.147129:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 216 00000100:00100000:3.0:1788642214.147145:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:8148:x1875527086385408:12345-192.168.202.49@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788642214.147435:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:8148:x1875527086385408:12345-192.168.202.49@tcp:503:mount.lustre.0 Request processed in 294us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642214.147444:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 216 00000100:00100000:1.0:1788642214.152638:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642214.152836:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086385536 00000100:00100000:2.0:1788642214.152851:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086385536 00000100:00100000:2.0:1788642214.152955:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 217 00000100:00100000:2.0:1788642214.152969:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:8156:x1875527086385536:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788642214.153492:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:8156:x1875527086385536:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 524us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642214.153500:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 217 00000100:00100000:1.0:1788642214.158975:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642214.162358:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086385664 00000100:00100000:3.0:1788642214.162382:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086385664 00000100:00100000:3.0:1788642214.162543:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 218 00000100:00100000:3.0:1788642214.162558:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:8156:x1875527086385664:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788642214.162949:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:8156:x1875527086385664:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 382us (3978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642214.162961:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 218 00000100:00100000:1.0:1788642214.172766:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642214.172871:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642214.178983:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086385792 00000100:00100000:0.0:1788642214.179010:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086385792 00000100:00100000:0.0:1788642214.179120:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086386176 00000100:00100000:0.0:1788642214.179126:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086386176 00000100:00100000:0.0:1788642214.179189:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:0.0:1788642214.179201:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086386176:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642214.179321:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086386176:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 122us (6448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642214.179332:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:0.0:1788642214.179355:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:0.0:1788642214.179359:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1875527086385792:12345-192.168.202.49@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788642214.179410:0:5861:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5@192.168.202.49@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:0.0:1788642214.179459:0:5861:0:(genops.c:1385:class_connect()) connect: client 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5, cookie 0x4ae1ee156666d224 00000004:00100000:0.0:1788642214.179502:0:5861:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788642214.179731:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788642214.180223:0:5861:0:(import.c:65:import_set_state_nolock()) ffff8dddef7f9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788642214.180279:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2358:x1875527086385792:12345-192.168.202.49@tcp:38:mount.lustre.0 Request processed in 917us (7527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642214.180288:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788642214.183158:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642214.183212:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642214.183382:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086386048 00000100:00100000:3.0:1788642214.183395:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086386048 00000100:00100000:3.0:1788642214.183490:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086385920 00000100:00100000:3.0:1788642214.183494:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086385920 00000100:00100000:3.0:1788642214.183521:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:3.0:1788642214.183533:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+7:8148:x1875527086386048:12345-192.168.202.49@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788642214.183678:0:5862:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1788642214.185193:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642214.185256:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:2.0:1788642214.185284:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+7:0:x1875527086385920:12345-192.168.202.49@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788642214.185332:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788642214.187221:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+7:0:x1875527086385920:12345-192.168.202.49@tcp:41:mount.lustre.0 Request processed in 1940us (3994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642214.187236:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:0.0:1788642214.188695:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:8148:x1875527086386048:12345-192.168.202.49@tcp:41:mount.lustre.0 Request processed in 5152us (5587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642214.188709:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:0.0:1788642214.195811:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642214.195970:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086386304 00000100:00100000:2.0:1788642214.195991:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086386304 00000100:00100000:2.0:1788642214.196556:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:2.0:1788642214.196807:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:8148:x1875527086386304:12345-192.168.202.49@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788642214.197051:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:8148:x1875527086386304:12345-192.168.202.49@tcp:40:mount.lustre.0 Request processed in 482us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642214.197205:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:2.0:1788642214.202146:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642214.202195:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642214.202266:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642214.202348:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086386688 00000100:00100000:3.0:1788642214.202372:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086386688 00000100:00100000:3.0:1788642214.202437:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:3.0:1788642214.202450:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:8148:x1875527086386688:12345-192.168.202.49@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788642214.202564:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788642214.202896:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086386432 00000100:00100000:0.0:1788642214.202901:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086386432 00000100:00100000:0.0:1788642214.202931:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086386560 00000100:00100000:0.0:1788642214.202934:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086386560 00000100:00100000:0.0:1788642214.202967:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:0.0:1788642214.202974:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875527086386432:12345-192.168.202.49@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788642214.203005:0:6711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5@192.168.202.49@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:0.0:1788642214.203053:0:6711:0:(genops.c:1385:class_connect()) connect: client 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5, cookie 0x4ae1ee156666d22b 00002000:00100000:0.0:1788642214.203080:0:6711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5/ffff8dddef7fb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788642214.203141:0:6711:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788642214.203443:0:6711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788642214.203488:0:6711:0:(import.c:65:import_set_state_nolock()) ffff8dddef7fc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788642214.204242:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:8148:x1875527086386688:12345-192.168.202.49@tcp:33:mount.lustre.0 Request processed in 1788us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642214.204255:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:3.0:1788642214.204343:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:3.0:1788642214.204350:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875527086386560:12345-192.168.202.49@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788642214.204383:0:9442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5@192.168.202.49@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:3.0:1788642214.204420:0:9442:0:(genops.c:1385:class_connect()) connect: client 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5, cookie 0x4ae1ee156666d232 00002000:00100000:3.0:1788642214.204431:0:9442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5/ffff8dddfb5a3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788642214.204453:0:9442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788642214.206317:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2358:x1875527086386432:12345-192.168.202.49@tcp:8:mount.lustre.0 Request processed in 3324us (4103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642214.206359:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00002000:00080000:0.0:1788642214.228056:0:9442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788642214.228126:0:9442:0:(import.c:65:import_set_state_nolock()) ffff8dddef7fb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788642214.229177:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2358:x1875527086386560:12345-192.168.202.49@tcp:8:mount.lustre.0 Request processed in 24819us (26905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642214.229264:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00010000:00010000:0.0:1788642214.842383:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642215.610481:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddface6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107391616:0@lo:400:kworker.0 00000100:00100000:2.0:1788642215.610589:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642215.610675:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788642215.610682:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddface7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107391488:0@lo:400:kworker.0 00000100:00100000:2.0:1788642215.610750:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642215.610797:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107391488 00000100:00100000:2.0:1788642215.610808:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107391488 00000100:00100000:2.0:1788642215.610902:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788642215.610914:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107391488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642215.610994:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107391488:12345-0@lo:400:kworker.0 Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642215.611003:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788642215.611030:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642215.611068:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddface7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107391488:0@lo:400:kworker.0 00000100:00100000:0.0:1788642215.611722:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddface5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107391232:0@lo:400:kworker.0 00000100:00100000:0.0:1788642215.611784:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642215.611827:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddface5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107391744:0@lo:400:kworker.0 00000100:00100000:0.0:1788642215.611858:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642215.611883:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788642215.611891:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddface4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107391360:0@lo:400:kworker.0 00000100:00100000:0.0:1788642215.611915:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642215.611947:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddface7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107391872:0@lo:400:kworker.0 00000100:00100000:0.0:1788642215.611974:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642215.612016:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107391616 00000100:00100000:0.0:1788642215.612022:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107391616 00000100:00100000:0.0:1788642215.612076:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107391872 00000100:00100000:0.0:1788642215.612080:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107391872 00000100:00100000:0.0:1788642215.612126:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788642215.612135:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107391616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642215.612187:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107391616:12345-0@lo:400:kworker.0 Request processed in 53us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642215.612194:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788642215.612223:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788642215.612229:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107391872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642215.612266:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107391872:12345-0@lo:400:kworker.0 Request processed in 37us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642215.612272:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788642215.612289:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107391744 00000100:00100000:0.0:1788642215.612293:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107391744 00000100:00100000:0.0:1788642215.612319:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107391360 00000100:00100000:0.0:1788642215.612321:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107391360 00000100:00100000:0.0:1788642215.612333:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788642215.612338:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107391744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642215.613047:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107391744:12345-0@lo:400:kworker.0 Request processed in 702us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642215.613057:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788642215.613078:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788642215.613086:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107391360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642215.613143:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107391360:12345-0@lo:400:kworker.0 Request processed in 60us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642215.613149:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788642215.613174:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107391232 00000100:00100000:0.0:1788642215.613180:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107391232 00000100:00080000:2.0:1788642215.613407:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788642215.613414:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788642215.614855:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788642215.615015:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddface6680 x1875527107391616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642215.615041:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddface6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107391616:0@lo:400:kworker.0 00000100:00100000:2.0:1788642215.615131:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddface4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107391360:0@lo:400:kworker.0 00010000:00080000:2.0:1788642215.615148:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddface7480 x1875527107391872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642215.615159:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddface7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107391872:0@lo:400:kworker.0 00000100:00100000:2.0:1788642215.615174:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddface5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107391744:0@lo:400:kworker.0 00000100:00100000:0.0:1788642215.615575:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788642215.615598:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107391232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642215.617409:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107391232:12345-0@lo:400:kworker.0 Request processed in 129us (3929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642215.617550:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788642215.617787:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddface5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107391232:0@lo:400:kworker.0 00010000:00010000:2.0:1788642215.866334:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642216.125349:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107392000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788642216.125461:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642216.125567:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107392000 00000100:00100000:0.0:1788642216.125579:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107392000 00000100:00100000:0.0:1788642216.125649:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788642216.125660:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107392000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788642216.125710:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642216.125768:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107392000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642216.125777:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788642216.125833:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc7395180 x1875527107392000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642216.125858:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107392000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788642216.891242:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642217.146334:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642217.146356:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107392128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642217.146428:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642217.146487:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107392128 00000100:00100000:0.0:1788642217.146494:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107392128 00000100:00100000:0.0:1788642217.146561:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788642217.146570:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107392128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788642217.146608:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642217.146659:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107392128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642217.146666:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788642217.146689:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788642217.146701:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc7395180 x1875527107392128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642217.146720:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107392128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788642217.917743:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788642218.772248:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 00010000:00010000:2.0:1788642218.938386:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788642219.236836:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 00000001:00100000:2.0:1788642219.259926:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 00000100:00100000:3.0:1788642219.687549:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642219.687609:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642219.687644:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642219.687679:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642219.687723:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642219.687760:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086387200 00000100:00100000:3.0:1788642219.687809:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086387200 00000100:00100000:3.0:1788642219.687884:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086387328 00000100:00100000:3.0:1788642219.687888:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086387328 00000100:00100000:3.0:1788642219.687912:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:3.0:1788642219.687921:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086387200:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642219.687990:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086387200:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 70us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642219.687992:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086386816 00000100:00100000:1.0:1788642219.687997:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086386816 00000100:00100000:3.0:1788642219.688006:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:3.0:1788642219.688023:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:1.0:1788642219.688023:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 220 00000100:00100000:3.0:1788642219.688029:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086387328:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642219.688030:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2362:x1875527086386816:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642219.688093:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086386944 00000100:00100000:2.0:1788642219.688120:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086386944 00000100:00100000:2.0:1788642219.688151:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086387072 00000100:00100000:2.0:1788642219.688153:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086387072 00000100:00100000:2.0:1788642219.688174:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:2.0:1788642219.688181:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086386944:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642219.688235:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086387328:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 24us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642219.688243:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00080000:3.0:1788642219.688259:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788642219.688264:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788642219.688266:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642219.694030:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2362:x1875527086386816:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 5810us (6194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642219.694047:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 220 00000100:00100000:1.0:1788642219.694168:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:1.0:1788642219.694184:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086387072:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642219.694242:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086387072:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 65us (6561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642219.694248:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:2.0:1788642219.702232:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086386944:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 14035us (14682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642219.702250:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 69 00010000:00010000:1.0:1788642219.964150:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788642220.499415:0:10346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788642220.734051:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107392384:0@lo:400:kworker.0 00000100:00100000:3.0:1788642220.734565:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642220.735003:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107392896:0@lo:400:kworker.0 00000100:00100000:3.0:1788642220.735048:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642220.735271:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107392256:0@lo:400:kworker.0 00000100:00100000:2.0:1788642220.735311:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642220.735337:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107392768:0@lo:400:kworker.0 00000100:00100000:2.0:1788642220.735364:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642220.735406:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107392256 00000100:00100000:2.0:1788642220.735414:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107392256 00000100:00100000:2.0:1788642220.735466:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788642220.735477:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107392256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642220.735537:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107392256:12345-0@lo:400:kworker.0 Request processed in 61us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642220.735545:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788642220.735579:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107392384 00000100:00100000:2.0:1788642220.735584:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107392384 00000100:00100000:2.0:1788642220.735609:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107392768 00000100:00100000:2.0:1788642220.735612:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107392768 00000100:00100000:2.0:1788642220.736717:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788642220.736733:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107392384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642220.736816:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107392384:12345-0@lo:400:kworker.0 Request processed in 89us (2253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642220.736834:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788642220.736853:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788642220.736860:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107392768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642220.736890:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107392768:12345-0@lo:400:kworker.0 Request processed in 31us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642220.736896:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788642220.736959:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107392256:0@lo:400:kworker.0 00000100:00100000:2.0:1788642220.736976:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107392768:0@lo:400:kworker.0 00000100:00100000:3.0:1788642220.737081:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107392384:0@lo:400:kworker.0 00000100:00100000:3.0:1788642220.737273:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107392512:0@lo:400:kworker.0 00000100:00100000:3.0:1788642220.737313:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642220.737345:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642220.737352:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107392640:0@lo:400:kworker.0 00000100:00100000:3.0:1788642220.737384:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642220.737430:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107392512 00000100:00100000:3.0:1788642220.737438:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107392512 00000100:00100000:3.0:1788642220.737480:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788642220.737487:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107392512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642220.737537:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107392512:12345-0@lo:400:kworker.0 Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642220.737543:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788642220.737566:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107392896 00000100:00100000:3.0:1788642220.737570:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107392896 00000100:00100000:3.0:1788642220.737601:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107392640 00000100:00100000:3.0:1788642220.737603:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107392640 00000100:00100000:3.0:1788642220.739894:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788642220.739924:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107392896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642220.740052:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107392896:12345-0@lo:400:kworker.0 Request processed in 141us (5003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642220.740059:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788642220.740077:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788642220.740083:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef7da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107392640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642220.740203:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef7da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107392640:12345-0@lo:400:kworker.0 Request processed in 119us (2817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642220.740209:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788642220.740497:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfab09880 x1875527107392896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642220.740514:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107392896:0@lo:400:kworker.0 00000100:00080000:3.0:1788642220.740906:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788642220.740913:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788642220.740917:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788642220.740947:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfab0ad80 x1875527107392640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642220.740958:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107392640:0@lo:400:kworker.0 00000100:00100000:3.0:1788642220.740971:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107392512:0@lo:400:kworker.0 00010000:00010000:0.0:1788642220.988115:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642221.245355:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788642221.245377:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107393024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642221.245452:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642221.245515:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107393024 00000100:00100000:3.0:1788642221.245524:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107393024 00000100:00100000:3.0:1788642221.248560:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788642221.248580:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107393024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642221.248637:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642221.248739:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107393024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (3285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642221.248746:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788642221.253595:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfab0aa00 x1875527107393024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642221.253639:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107393024:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788642222.010512:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642222.273265:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642222.273297:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107393152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642222.273417:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642222.273513:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107393152 00000100:00100000:3.0:1788642222.273523:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107393152 00000100:00100000:3.0:1788642222.273598:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788642222.273609:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107393152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642222.273657:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642222.273716:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107393152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642222.273724:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788642222.273752:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788642222.273797:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfab08a80 x1875527107393152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642222.273822:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107393152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788642223.034519:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642224.058410:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642224.797279:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642224.797327:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642224.797406:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642224.797447:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642224.797477:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642224.797512:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086387584 00000100:00100000:3.0:1788642224.797525:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086387584 00000100:00100000:3.0:1788642224.797598:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086387712 00000100:00100000:3.0:1788642224.797602:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086387712 00000100:00100000:3.0:1788642224.797629:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 74 00000100:00100000:3.0:1788642224.797641:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086387584:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642224.797755:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086387584:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 115us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642224.797763:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 74 00000100:00100000:3.0:1788642224.797783:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 75 00000100:00100000:3.0:1788642224.797790:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086387712:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642224.797816:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086387712:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 26us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642224.797823:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 75 00000100:00100000:3.0:1788642224.797844:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086387840 00000100:00100000:3.0:1788642224.797848:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086387840 00000100:00100000:3.0:1788642224.797877:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086387968 00000100:00100000:3.0:1788642224.797880:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086387968 00000100:00100000:3.0:1788642224.797901:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:3.0:1788642224.797908:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086387840:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642224.797955:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086387840:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 46us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642224.797962:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:3.0:1788642224.797982:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:3.0:1788642224.797989:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086387968:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642224.798028:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086387968:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 39us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642224.798035:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00080000:3.0:1788642224.798052:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788642224.798057:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788642224.798061:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642224.798656:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086387456 00000100:00100000:0.0:1788642224.798664:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086387456 00000100:00100000:0.0:1788642224.798755:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 222 00000100:00100000:0.0:1788642224.798765:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086387456:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642224.798824:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086387456:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 61us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642224.798831:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 222 00010000:00010000:2.0:1788642225.085146:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642225.856305:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107393664:0@lo:400:kworker.0 00000100:00100000:1.0:1788642225.856403:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642225.856473:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788642225.856479:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107393536:0@lo:400:kworker.0 00000100:00100000:1.0:1788642225.856518:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642225.857334:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107393280:0@lo:400:kworker.0 00000100:00100000:2.0:1788642225.857398:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642225.857448:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107393792:0@lo:400:kworker.0 00000100:00100000:2.0:1788642225.857477:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642225.857513:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788642225.857520:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107393408:0@lo:400:kworker.0 00000100:00100000:2.0:1788642225.857555:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642225.857572:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107393920:0@lo:400:kworker.0 00000100:00100000:2.0:1788642225.857596:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642225.857830:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107393664 00000100:00100000:3.0:1788642225.857841:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107393664 00000100:00100000:3.0:1788642225.857923:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107393920 00000100:00100000:3.0:1788642225.857927:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107393920 00000100:00100000:3.0:1788642225.857954:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788642225.857966:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107393664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642225.858036:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107393664:12345-0@lo:400:kworker.0 Request processed in 72us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642225.858044:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788642225.858064:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788642225.858071:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107393920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642225.858126:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107393920:12345-0@lo:400:kworker.0 Request processed in 55us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642225.858133:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788642225.858154:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107393536 00000100:00100000:3.0:1788642225.858158:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107393536 00000100:00100000:3.0:1788642225.858186:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107393792 00000100:00100000:3.0:1788642225.858189:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107393792 00000100:00100000:3.0:1788642225.858215:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107393408 00000100:00100000:3.0:1788642225.858218:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107393408 00000100:00100000:3.0:1788642225.858252:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788642225.858257:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107393536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642225.858292:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107393536:12345-0@lo:400:kworker.0 Request processed in 35us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642225.858299:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788642225.858311:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788642225.858317:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107393792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642225.858345:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107393792:12345-0@lo:400:kworker.0 Request processed in 29us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642225.858351:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788642225.858362:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788642225.858368:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107393408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642225.858398:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107393408:12345-0@lo:400:kworker.0 Request processed in 30us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642225.858404:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788642225.858438:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788642225.858444:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788642225.858446:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642225.858893:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107393536:0@lo:400:kworker.0 00010000:00080000:3.0:1788642225.858917:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc5dcd500 x1875527107393664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642225.858929:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107393664:0@lo:400:kworker.0 00000100:00100000:3.0:1788642225.858972:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107393408:0@lo:400:kworker.0 00010000:00080000:3.0:1788642225.858984:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc5dcf100 x1875527107393920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642225.859008:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107393920:0@lo:400:kworker.0 00000100:00100000:3.0:1788642225.859024:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107393792:0@lo:400:kworker.0 00000100:00100000:1.0:1788642225.859553:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107393280 00000100:00100000:1.0:1788642225.859561:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107393280 00000100:00100000:1.0:1788642225.859628:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788642225.859637:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107393280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642225.859707:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107393280:12345-0@lo:400:kworker.0 Request processed in 71us (2309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642225.859714:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788642225.859990:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107393280:0@lo:400:kworker.0 00010000:00010000:0.0:1788642226.106651:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642226.362511:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107394048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642226.362643:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642226.363138:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107394048 00000100:00100000:1.0:1788642226.363151:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107394048 00000100:00100000:1.0:1788642226.363217:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788642226.363229:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107394048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642226.363275:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642226.363348:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107394048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642226.363356:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788642226.363527:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfab0a680 x1875527107394048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642226.363561:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107394048:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788642227.131282:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642227.386484:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107394176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642227.386594:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642227.386713:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107394176 00000100:00100000:3.0:1788642227.386723:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107394176 00000100:00100000:3.0:1788642227.386800:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788642227.386811:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107394176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642227.387002:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642227.387063:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107394176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 255us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642227.387072:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788642227.387125:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788642227.387164:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfab0a680 x1875527107394176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642227.387188:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107394176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788642228.157709:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642229.185501:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642229.928145:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642229.928202:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642229.928239:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642229.928285:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642229.928320:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642229.928364:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086388224 00000100:00100000:0.0:1788642229.928378:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086388224 00000100:00100000:0.0:1788642229.928461:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086388352 00000100:00100000:0.0:1788642229.928466:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086388352 00000100:00100000:0.0:1788642229.928500:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:0.0:1788642229.928534:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2360:x1875527086388224:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642229.928647:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2360:x1875527086388224:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 116us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642229.928656:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:0.0:1788642229.928677:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:0.0:1788642229.928684:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086388352:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642229.928710:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086388352:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 27us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642229.928715:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:0.0:1788642229.928736:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086388480 00000100:00100000:0.0:1788642229.928740:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086388480 00000100:00100000:0.0:1788642229.928768:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086388608 00000100:00100000:0.0:1788642229.928771:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086388608 00000100:00100000:0.0:1788642229.928791:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:0.0:1788642229.928799:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086388480:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642229.928827:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086388480:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 29us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642229.928833:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:0.0:1788642229.928845:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:0.0:1788642229.928851:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086388608:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642229.928874:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086388608:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 23us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642229.928893:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00080000:0.0:1788642229.928918:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642229.928931:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788642229.928934:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642229.929565:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086388096 00000100:00100000:3.0:1788642229.929575:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086388096 00000100:00100000:3.0:1788642229.929632:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 224 00000100:00100000:3.0:1788642229.929650:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086388096:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642229.929693:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086388096:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 46us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642229.929701:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 224 00010000:00010000:0.0:1788642230.202255:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642230.970526:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107394432:0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.970628:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642230.970704:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107394944:0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.970818:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642230.970861:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788642230.970868:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107394304:0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.970905:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642230.970931:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107394816:0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.970954:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642230.970984:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107394560:0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.971010:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642230.971048:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642230.971055:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107394688:0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.971138:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642230.971181:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107394432 00000100:00100000:1.0:1788642230.971192:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107394432 00000100:00100000:1.0:1788642230.971252:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107394816 00000100:00100000:1.0:1788642230.971256:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107394816 00000100:00100000:1.0:1788642230.971283:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107394560 00000100:00100000:1.0:1788642230.971287:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107394560 00000100:00100000:1.0:1788642230.971308:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788642230.971320:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107394432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.971394:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107394432:12345-0@lo:400:kworker.0 Request processed in 76us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642230.971403:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788642230.971425:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788642230.971432:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107394816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.971460:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107394816:12345-0@lo:400:kworker.0 Request processed in 29us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642230.971466:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788642230.971478:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788642230.971484:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107394560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.971517:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107394560:12345-0@lo:400:kworker.0 Request processed in 33us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642230.971523:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788642230.971543:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107394944 00000100:00100000:1.0:1788642230.971547:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107394944 00000100:00100000:1.0:1788642230.971576:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107394688 00000100:00100000:1.0:1788642230.971580:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107394688 00000100:00100000:1.0:1788642230.971614:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788642230.971621:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107394944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.971656:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107394944:12345-0@lo:400:kworker.0 Request processed in 36us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642230.971662:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788642230.971673:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788642230.971679:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107394688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.971707:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107394688:12345-0@lo:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642230.971713:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788642230.974394:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107394304 00000100:00100000:1.0:1788642230.974415:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107394304 00000100:00100000:1.0:1788642230.976212:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788642230.976237:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107394304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.976373:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107394304:12345-0@lo:400:kworker.0 Request processed in 145us (5465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642230.976381:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:1.0:1788642230.986278:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788642230.986292:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788642230.986298:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788642230.986390:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc5dce680 x1875527107394688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642230.986411:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107394688:0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.986430:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107394560:0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.986489:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107394304:0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.986521:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107394816:0@lo:400:kworker.0 00000100:00100000:1.0:1788642230.986535:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107394432:0@lo:400:kworker.0 00010000:00080000:1.0:1788642230.986549:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddc5dcce00 x1875527107394944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642230.986560:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107394944:0@lo:400:kworker.0 00010000:00010000:1.0:1788642231.235840:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642231.482682:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107395072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788642231.482795:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642231.483046:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107395072 00000100:00100000:3.0:1788642231.483058:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107395072 00000100:00100000:3.0:1788642231.483149:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788642231.483161:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107395072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642231.483208:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642231.483266:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107395072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642231.483274:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788642231.483378:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfab0a680 x1875527107395072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642231.483400:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107395072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788642232.250377:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642232.516632:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107395200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642232.516735:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642232.517243:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107395200 00000100:00100000:1.0:1788642232.517255:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107395200 00000100:00100000:1.0:1788642232.517328:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788642232.518461:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107395200:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788642232.518608:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788642232.519484:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642232.519769:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107395200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1311us (3027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642232.519782:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788642232.520030:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddeff81880 x1875527107395200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642232.520065:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107395200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788642233.279273:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642234.299341:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642235.033788:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642235.033846:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642235.033878:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642235.034085:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086388864 00000100:00100000:0.0:1788642235.034141:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086388864 00000100:00100000:0.0:1788642235.034219:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086388992 00000100:00100000:0.0:1788642235.034222:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086388992 00000100:00100000:0.0:1788642235.034248:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:0.0:1788642235.034260:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086388864:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642235.034380:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086388864:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 121us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642235.034400:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:0.0:1788642235.034420:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:0.0:1788642235.034436:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086388992:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642235.034500:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086388992:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 72us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642235.034508:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:0.0:1788642235.035172:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086388736 00000100:00100000:0.0:1788642235.035184:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086388736 00000100:00100000:0.0:1788642235.035224:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 226 00000100:00100000:0.0:1788642235.035234:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086388736:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642235.035281:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086388736:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 49us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642235.035286:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 226 00000100:00080000:3.0:1788642235.035978:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642235.053511:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642235.053556:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642235.053604:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086389120 00000100:00100000:2.0:1788642235.053617:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086389120 00000100:00100000:2.0:1788642235.053711:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086389248 00000100:00100000:2.0:1788642235.053715:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086389248 00000100:00100000:2.0:1788642235.053743:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788642235.053755:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2358:x1875527086389120:12345-192.168.202.49@tcp:9:kworker.0 00000020:00000080:2.0:1788642235.053797:0:9442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d22b 00000100:00080000:2.0:1788642235.053809:0:9442:0:(import.c:65:import_set_state_nolock()) ffff8dddef7fc800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788642235.053861:0:9442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788642235.054375:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+2:2358:x1875527086389120:12345-192.168.202.49@tcp:9:kworker.0 Request processed in 618us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642235.054385:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788642235.054407:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:2.0:1788642235.054416:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2358:x1875527086389248:12345-192.168.202.49@tcp:9:kworker.0 00000020:00000080:2.0:1788642235.054432:0:9442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d232 00000100:00080000:2.0:1788642235.054440:0:9442:0:(import.c:65:import_set_state_nolock()) ffff8dddef7fb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788642235.054466:0:9442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788642235.054693:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+2:2358:x1875527086389248:12345-192.168.202.49@tcp:9:kworker.0 Request processed in 277us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642235.054700:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00010000:00010000:2.0:1788642235.054734:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642235.054742:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788642235.054753:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788642235.054758:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788642235.322358:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642236.091010:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107395584:0@lo:400:kworker.0 00000100:00100000:0.0:1788642236.091161:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642236.091249:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642236.091256:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107395712:0@lo:400:kworker.0 00000100:00100000:0.0:1788642236.091289:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642236.091350:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107395712 00000100:00100000:0.0:1788642236.091360:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107395712 00000100:00100000:0.0:1788642236.091439:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788642236.091450:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107395712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642236.091514:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107395712:12345-0@lo:400:kworker.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642236.091522:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788642236.091547:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788642236.091586:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddeff80e00 x1875527107395712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642236.091626:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107395712:0@lo:400:kworker.0 00000100:00100000:1.0:1788642236.092225:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107395584 00000100:00100000:1.0:1788642236.092234:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107395584 00000100:00100000:1.0:1788642236.092299:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788642236.092309:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107395584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642236.092383:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107395584:12345-0@lo:400:kworker.0 Request processed in 75us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642236.092390:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788642236.092457:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107395456:0@lo:400:kworker.0 00000100:00100000:3.0:1788642236.092534:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642236.092592:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107395968:0@lo:400:kworker.0 00000100:00100000:3.0:1788642236.092619:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642236.092671:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788642236.092677:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107395328:0@lo:400:kworker.0 00000100:00100000:3.0:1788642236.092708:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642236.092728:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107395840:0@lo:400:kworker.0 00000100:00100000:3.0:1788642236.092768:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642236.093091:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107395456 00000100:00100000:1.0:1788642236.093143:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107395456 00000100:00100000:2.0:1788642236.093180:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107395968 00000100:00100000:2.0:1788642236.093190:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107395968 00000100:00100000:1.0:1788642236.093198:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107395840 00000100:00100000:1.0:1788642236.093211:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107395840 00000100:00100000:2.0:1788642236.093257:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788642236.093262:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788642236.093275:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107395968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642236.093277:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107395456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642236.093376:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107395968:12345-0@lo:400:kworker.0 Request processed in 104us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642236.093386:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788642236.093445:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107395456:0@lo:400:kworker.0 00010000:00080000:2.0:1788642236.093463:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddeff82680 x1875527107395968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642236.093473:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107395968:0@lo:400:kworker.0 00000100:00100000:1.0:1788642236.093501:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107395456:12345-0@lo:400:kworker.0 Request processed in 111us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642236.093513:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788642236.093539:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788642236.093547:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107395840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642236.093596:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107395840:12345-0@lo:400:kworker.0 Request processed in 50us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642236.093603:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788642236.093638:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107395328 00000100:00100000:1.0:1788642236.093642:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107395328 00000100:00100000:1.0:1788642236.093672:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788642236.093677:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107395328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642236.093705:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107395328:12345-0@lo:400:kworker.0 Request processed in 28us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642236.093710:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:0.0:1788642236.093792:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642236.093800:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642236.093835:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107395584:0@lo:400:kworker.0 00000100:00100000:2.0:1788642236.094240:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107395328:0@lo:400:kworker.0 00000100:00100000:2.0:1788642236.094257:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107395840:0@lo:400:kworker.0 00010000:00010000:2.0:1788642236.346674:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642236.603436:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788642236.603466:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107396096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642236.603555:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642236.603631:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107396096 00000100:00100000:3.0:1788642236.603640:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107396096 00000100:00100000:3.0:1788642236.603690:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788642236.603701:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107396096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642236.603736:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642236.603785:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107396096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642236.603792:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788642236.603836:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfab0aa00 x1875527107396096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642236.603852:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107396096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788642237.370359:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642237.626717:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642237.626743:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107396224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642237.626840:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642237.627005:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107396224 00000100:00100000:1.0:1788642237.627013:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107396224 00000100:00100000:1.0:1788642237.627063:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788642237.627071:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107396224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788642237.627145:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642237.627197:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107396224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642237.627204:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788642237.627523:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddeff81c00 x1875527107396224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642237.627541:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107396224:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788642238.404473:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788642239.259535:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 00000020:00000080:3.0:1788642239.259551:0:6736:0:(genops.c:885:class_export_put()) final put ffff8dddef7fb800/86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 00000020:00000080:0.0:1788642239.259776:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddef7fb800/86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 for lustre-OST0000 00000020:00000080:0.0:1788642239.259841:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddef7fc800 for lustre-OST0000 00010000:00010000:2.0:1788642239.421373:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788642239.781911:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 00000020:00000080:2.0:1788642239.781924:0:7669:0:(genops.c:885:class_export_put()) final put ffff8dddfb5a3000/86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 00000020:00000080:0.0:1788642239.782003:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfb5a3000/86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 for lustre-OST0001 00000020:00000080:0.0:1788642239.782076:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddef7fb000 for lustre-OST0001 00000100:00100000:2.0:1788642240.152729:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642240.152780:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642240.152810:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642240.152861:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086389376 00000100:00100000:2.0:1788642240.152875:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086389376 00000100:00100000:2.0:1788642240.152942:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 228 00000100:00100000:2.0:1788642240.152954:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2362:x1875527086389376:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642240.153078:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2362:x1875527086389376:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 126us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642240.153087:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 228 00000100:00100000:2.0:1788642240.153162:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086389632 00000100:00100000:2.0:1788642240.153167:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086389632 00000100:00100000:2.0:1788642240.153442:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086389504 00000100:00100000:2.0:1788642240.153447:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086389504 00000100:00100000:2.0:1788642240.153480:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00100000:2.0:1788642240.153615:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086389632:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642240.153658:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086389632:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 171us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642240.153667:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00100000:2.0:1788642240.153681:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00100000:2.0:1788642240.153688:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086389504:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642240.153715:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086389504:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 28us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642240.153734:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00080000:2.0:1788642240.153917:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788642240.397656:0:11050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788642240.446061:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642241.210707:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107396352:0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.210820:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642241.210886:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107396864:0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.210917:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642241.210951:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788642241.210958:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107396480:0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.210981:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642241.211001:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107396992:0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.211028:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642241.211087:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107396608:0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.211151:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642241.211173:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642241.211180:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107396736:0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.211204:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642241.211238:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107396352 00000100:00100000:0.0:1788642241.211249:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107396352 00000100:00100000:0.0:1788642241.211309:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788642241.211321:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107396352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.211384:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107396352:12345-0@lo:400:kworker.0 Request processed in 65us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642241.211393:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788642241.211432:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107396864 00000100:00100000:0.0:1788642241.211436:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107396864 00000100:00100000:0.0:1788642241.211475:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107396480 00000100:00100000:0.0:1788642241.211478:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107396480 00000100:00100000:0.0:1788642241.211490:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107396608 00000100:00100000:0.0:1788642241.211492:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107396608 00000100:00100000:0.0:1788642241.211506:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788642241.211512:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107396864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.211545:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107396864:12345-0@lo:400:kworker.0 Request processed in 33us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642241.211551:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788642241.211575:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788642241.211582:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107396480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.211611:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107396480:12345-0@lo:400:kworker.0 Request processed in 30us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642241.211629:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788642241.211642:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788642241.211647:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107396608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.211682:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107396608:12345-0@lo:400:kworker.0 Request processed in 35us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642241.211688:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788642241.211713:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107396992 00000100:00100000:0.0:1788642241.211718:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107396992 00000100:00100000:0.0:1788642241.211748:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107396736 00000100:00100000:0.0:1788642241.211751:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107396736 00000100:00100000:0.0:1788642241.211773:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788642241.211780:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107396992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.211814:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107396992:12345-0@lo:400:kworker.0 Request processed in 35us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642241.211820:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788642241.211834:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788642241.211839:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107396736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.211865:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107396736:12345-0@lo:400:kworker.0 Request processed in 27us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642241.211870:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788642241.211900:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788642241.211905:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642241.211908:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788642241.211950:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfb4b4a80 x1875527107396736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642241.211966:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107396736:0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.211987:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107396608:0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.212023:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107396480:0@lo:400:kworker.0 00010000:00080000:0.0:1788642241.212034:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfb4b7800 x1875527107396992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642241.212044:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107396992:0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.212053:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107396352:0@lo:400:kworker.0 00000100:00100000:0.0:1788642241.212064:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107396864:0@lo:400:kworker.0 00010000:00010000:1.0:1788642241.469071:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642241.724855:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107397120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642241.724951:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642241.725050:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107397120 00000100:00100000:3.0:1788642241.725060:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107397120 00000100:00100000:3.0:1788642241.725156:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788642241.725167:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107397120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642241.725214:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642241.725291:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107397120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642241.725301:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788642241.725356:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfab0aa00 x1875527107397120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642241.725378:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107397120:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788642242.490514:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642242.747402:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107397248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642242.747482:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642242.747597:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107397248 00000100:00100000:1.0:1788642242.747606:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107397248 00000100:00100000:1.0:1788642242.747661:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788642242.747672:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107397248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788642242.747708:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642242.747843:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107397248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642242.747851:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788642242.747892:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddeff83480 x1875527107397248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642242.747911:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107397248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788642243.514342:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788642244.322598:0:11198:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffba0e7f60 20000000:00000080:0.0:1788642244.322619:0:11198:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dddfaecdc00 uarg=0000000000000000 20000000:01000000:0.0:1788642244.323533:0:11198:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788642244.323542:0:11198:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788642244.323547:0:11198:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788642244.325168:0:11199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788642244.325338:0:11198:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788642244.337289:0:11198:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788642244.337657:0:11198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642244.337692:0:11198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d1de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96c1 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642244.337702:0:11198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d1ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d1e5 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642244.337740:0:11198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d1fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d1f3 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642244.337747:0:11198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666d208 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d201 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642244.337753:0:11198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d21d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96f9 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642244.337762:0:11198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642244.337817:0:11198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d21d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96f9 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642244.337837:0:11198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d21d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96f9 expref: 12 pid: 5853 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642244.337859:0:11198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddface6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11198:1875527107397376:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642244.338008:0:11198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666d208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d201 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642244.338018:0:11198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666d208 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d201 expref: 18 pid: 5854 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642244.338027:0:11198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddface4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11198:1875527107397504:0@lo:104: 00000100:00100000:2.0:1788642244.338074:0:11198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788642244.338174:0:11198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d1fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d1f3 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642244.338189:0:11198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d1fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d1f3 expref: 18 pid: 5853 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642244.338199:0:11198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11198:1875527107397632:0@lo:104: 00000100:00100000:2.0:1788642244.338227:0:11198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788642244.338258:0:11198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d1ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d1e5 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642244.338266:0:11198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d1ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d1e5 expref: 18 pid: 5854 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642244.338274:0:11198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11198:1875527107397760:0@lo:104: 00000100:00100000:2.0:1788642244.338294:0:11198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788642244.338315:0:11198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d1de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96c1 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642244.338325:0:11198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d1de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96c1 expref: 12 pid: 5856 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642244.338334:0:11198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11198:1875527107397888:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642244.338353:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107397504 00000100:00100000:0.0:1788642244.338362:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107397504 00000100:00100000:2.0:1788642244.338401:0:11198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfb4ba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642244.338407:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107397632 00000100:00100000:0.0:1788642244.338411:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107397632 00000100:00100000:0.0:1788642244.338424:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107397760 00000100:00100000:0.0:1788642244.338427:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107397760 00000100:00100000:0.0:1788642244.338442:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788642244.338452:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:11198:x1875527107397504:12345-0@lo:104: 00010000:00010000:0.0:1788642244.338467:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d208 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.338533:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788642244.338540:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+5:11198:x1875527107397504:12345-0@lo:104: Request processed in 89us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642244.338557:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788642244.338576:0:11198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddface4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11198:1875527107397504:0@lo:104: 00000100:00100000:0.0:1788642244.338582:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788642244.338591:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:11198:x1875527107397632:12345-0@lo:104: 00010000:00010000:0.0:1788642244.338600:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d1fa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.338655:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788642244.338668:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:11198:x1875527107397632:12345-0@lo:104: Request processed in 80us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642244.338674:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788642244.338687:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788642244.338692:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:11198:x1875527107397760:12345-0@lo:104: 00010000:00010000:0.0:1788642244.338699:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d1ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.338735:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788642244.338740:0:11198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11198:1875527107397632:0@lo:104: 00000100:00100000:0.0:1788642244.338742:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:11198:x1875527107397760:12345-0@lo:104: Request processed in 49us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642244.338753:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788642244.338755:0:11198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11198:1875527107397760:0@lo:104: 00010000:00010000:0.0:1788642244.338794:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788642244.338799:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d208 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.338806:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121e00 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642244.338811:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d208 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.338832:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d208 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642244.338839:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d208 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642244.338844:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788642244.338890:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d208 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.338897:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642244.338919:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d208 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.338927:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddd6121e00/0x4ae1ee156666d201 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d208 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642244.338931:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788642244.338943:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788642244.338946:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107398016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642244.338948:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d1fa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.338957:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121600 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642244.338959:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d1fa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.338970:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d1fa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642244.338976:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d1fa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642244.338989:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788642244.338995:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788642244.339011:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d1fa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339019:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642244.339030:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d1fa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642244.339035:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107398144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642244.339038:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddd6121600/0x4ae1ee156666d1f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d1fa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339050:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642244.339053:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d1ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642244.339062:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788642244.339063:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51400 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642244.339067:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d1ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339073:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d1ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642244.339081:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d1ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642244.339086:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788642244.339138:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d1ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339144:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642244.339166:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d1ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339172:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51400/0x4ae1ee156666d1e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d1ec expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339192:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642244.339194:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642244.339196:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642244.339203:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642244.339208:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642244.339226:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107398016 00000100:00100000:0.0:1788642244.339231:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107398016 00010000:00010000:0.0:1788642244.339251:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666d208 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d201 expref: 19 pid: 5854 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642244.339269:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107398144 00000100:00100000:0.0:1788642244.339272:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107398144 00010000:00010000:0.0:1788642244.339280:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d1fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d1f3 expref: 20 pid: 5853 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642244.339291:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788642244.339296:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddde4e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+20:3318:x1875527107398016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642244.339307:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642244.339311:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666d208 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d201 expref: 20 pid: 5854 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339319:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666d208 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d201 expref: 20 pid: 5854 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339330:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9832a00/0x4ae1ee156666d208 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d201 expref: 20 pid: 5854 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339348:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642244.339387:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddde4e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107398016:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642244.339394:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788642244.339433:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788642244.339439:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:3318:x1875527107398144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642244.339446:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642244.339450:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d1fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d1f3 expref: 18 pid: 5853 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339458:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d1fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d1f3 expref: 18 pid: 5853 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339469:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddd6121200/0x4ae1ee156666d1fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d1f3 expref: 18 pid: 5853 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339477:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642244.339499:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:3318:x1875527107398144:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642244.339504:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788642244.339527:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107398272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642244.339551:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642244.339588:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107398272 00000100:00100000:0.0:1788642244.339592:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107398272 00010000:00010000:0.0:1788642244.339605:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d1ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d1e5 expref: 17 pid: 5854 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642244.339623:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788642244.339637:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:3319:x1875527107398272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642244.339644:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642244.339649:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d1ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d1e5 expref: 17 pid: 5854 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339656:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d1ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d1e5 expref: 17 pid: 5854 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339666:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d1ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d1e5 expref: 17 pid: 5854 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.339675:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642244.339702:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:3319:x1875527107398272:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642244.339708:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788642244.339742:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107398272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788642244.340068:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107398144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788642244.340078:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107398016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788642244.344865:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642244.345120:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086389760 00000100:00100000:1.0:1788642244.345129:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086389760 00010000:00010000:1.0:1788642244.345177:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d21d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96f9 expref: 13 pid: 5853 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642244.345218:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:1.0:1788642244.345227:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086389760:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642244.345241:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642244.345247:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d21d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96f9 expref: 13 pid: 5853 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.345260:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d21d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96f9 expref: 13 pid: 5853 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.345294:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642244.345349:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086389760:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 122us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642244.345357:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:3.0:1788642244.346150:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642244.346923:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086389888 00000100:00100000:1.0:1788642244.346933:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086389888 00010000:00010000:1.0:1788642244.346971:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d1de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96c1 expref: 13 pid: 5856 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642244.347015:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:1.0:1788642244.347025:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086389888:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642244.347039:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642244.347044:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d1de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96c1 expref: 13 pid: 5856 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.347056:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d1de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96c1 expref: 13 pid: 5856 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.347075:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.347082:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.347128:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.347308:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.347330:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.347337:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.347343:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1e00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642244.347347:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.347355:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.347364:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642244.347375:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642244.347577:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086389888:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 551us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642244.347584:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 29 00010000:00010000:0.0:1788642244.348322:0:11198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d21d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96f9 expref: 12 pid: 5853 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642244.348339:0:11198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddface6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11198:1875527107397376:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642244.348352:0:11198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666d1de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96c1 expref: 11 pid: 5856 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642244.348362:0:11198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11198:1875527107397888:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642244.348396:0:11198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.348406:0:11198:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.348423:0:11198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.348429:0:11198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666d239 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642244.538335:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642245.278004:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642245.278173:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642245.278459:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086390144 00000100:00100000:1.0:1788642245.278471:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086390144 00000100:00100000:1.0:1788642245.278539:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 94 00000100:00100000:1.0:1788642245.278548:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086390144:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642245.278635:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086390144:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 88us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642245.278643:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 94 00000100:00080000:0.0:1788642245.279002:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642245.279538:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642245.280388:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086390272 00000100:00100000:1.0:1788642245.280415:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086390272 00000100:00100000:1.0:1788642245.280501:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 95 00000100:00100000:1.0:1788642245.280513:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086390272:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642245.280605:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086390272:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 94us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642245.280612:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 95 00000100:00080000:0.0:1788642245.280743:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642245.282673:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086390016 00000100:00100000:2.0:1788642245.282695:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086390016 00000100:00100000:2.0:1788642245.282788:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 230 00000100:00100000:2.0:1788642245.282799:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+11:2361:x1875527086390016:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642245.282899:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+11:2361:x1875527086390016:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 101us (4905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642245.282907:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 230 00010000:00010000:0.0:1788642245.564990:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642246.044809:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642246.044902:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086390400 00000100:00100000:1.0:1788642246.044913:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086390400 00000100:00100000:3.0:1788642246.045818:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 231 00000100:00100000:3.0:1788642246.045834:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+11:5615:x1875527086390400:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788642246.045861:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642246.045882:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc0031000/0x4ae1ee156666d240 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9723 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642246.045914:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc0031000/0x4ae1ee156666d240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9723 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642246.045927:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc0031000/0x4ae1ee156666d240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9723 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642246.045945:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031000, rc 0) 00000100:00100000:3.0:1788642246.046019:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+12:5615:x1875527086390400:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 191us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642246.046041:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 231 00000100:00100000:3.0:1788642246.048018:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642246.066892:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086390528 00000100:00100000:0.0:1788642246.066910:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086390528 00000100:00100000:0.0:1788642246.066986:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 232 00000100:00100000:0.0:1788642246.066998:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+12:5615:x1875527086390528:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642246.067648:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+12:5615:x1875527086390528:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 647us (19636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642246.067659:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 232 00000100:00100000:2.0:1788642246.086878:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642246.086971:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086390656 00000100:00100000:1.0:1788642246.086987:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086390656 00000100:00100000:1.0:1788642246.087062:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 233 00000100:00100000:1.0:1788642246.087074:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+12:5615:x1875527086390656:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642246.087417:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+12:5615:x1875527086390656:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 342us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642246.087427:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 233 00000100:00100000:3.0:1788642246.097831:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642246.099122:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086390784 00000100:00100000:0.0:1788642246.099139:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086390784 00000100:00100000:0.0:1788642246.099208:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 234 00000100:00100000:0.0:1788642246.099219:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+12:5615:x1875527086390784:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788642246.099238:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642246.099402:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d247 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a972a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642246.099455:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a972a expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642246.099467:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a972a expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642246.099477:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833c00, rc 0) 00000100:00100000:0.0:1788642246.099589:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:5615:x1875527086390784:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 371us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642246.099596:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 234 00000100:00100000:1.0:1788642246.116159:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642246.116416:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086390912 00000100:00100000:3.0:1788642246.116425:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086390912 00000100:00100000:3.0:1788642246.116494:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 235 00000100:00100000:3.0:1788642246.116504:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:5615:x1875527086390912:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642246.116948:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:5615:x1875527086390912:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 443us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642246.116956:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 235 00000100:00100000:0.0:1788642246.133528:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642246.133633:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086391040 00000100:00100000:1.0:1788642246.133643:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086391040 00000100:00100000:1.0:1788642246.133697:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 236 00000100:00100000:1.0:1788642246.133709:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:5615:x1875527086391040:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642246.133949:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:5615:x1875527086391040:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 241us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642246.133957:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 236 10000000:01000000:2.0:1788642246.139187:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788642246.139197:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ddcc509b000 from 7 10000000:01000000:2.0:1788642246.139203:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788642246.139270:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642246.139284:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642246.139296:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642246.139324:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107398400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788642246.139415:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642246.139465:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642246.139547:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107398400 00000100:00100000:0.0:1788642246.139559:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107398400 00000100:00100000:0.0:1788642246.139619:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788642246.139639:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107398400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788642246.139654:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642246.139672:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9833200/0x4ae1ee156666d255 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d24e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642246.139699:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9833200/0x4ae1ee156666d255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d24e expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642246.139710:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9833200/0x4ae1ee156666d255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d24e expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642246.139719:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833200, rc 0) 00000100:00100000:0.0:1788642246.139774:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107398400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642246.139789:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788642246.139901:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107398400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642246.139918:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d255 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642246.139928:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d255 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642246.140012:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107398528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788642246.140046:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642246.140067:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc73e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642246.140085:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107398528 00000100:00100000:2.0:1788642246.140091:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107398528 00000100:00100000:2.0:1788642246.140147:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788642246.140156:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107398528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788642246.140432:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107398528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642246.140439:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788642246.141703:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107398528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642246.141760:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107398656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642246.141824:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642246.141876:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc537c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788642246.143143:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107398656 00000100:00100000:2.0:1788642246.143155:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107398656 00000100:00100000:2.0:1788642246.143207:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788642246.143217:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107398656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788642246.143449:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107398656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642246.143457:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788642246.148198:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107398656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788642246.151798:0:11248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788642246.152047:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788642246.152076:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788642246.152091:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d255 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642246.152123:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d255 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642246.152133:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788642246.152136:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddef9be800 from 7 10000000:01000000:3.0:1788642246.152139:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788642246.152187:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642246.152212:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642246.152226:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642246.152257:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107398784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788642246.152353:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642246.152408:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107398784 00000100:00100000:3.0:1788642246.152413:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc656be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788642246.152418:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107398784 00000100:00100000:0.0:1788642246.152587:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788642246.152598:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107398784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788642246.152892:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642246.152911:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666d263 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d25c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642246.152942:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666d263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d25c expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642246.152957:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666d263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d25c expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642246.152967:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833400, rc 0) 00000100:00100000:0.0:1788642246.153019:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107398784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 423us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642246.153026:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788642246.153166:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107398784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788642246.153182:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d263 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642246.153192:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d263 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642246.153259:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107398912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642246.153287:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642246.153311:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc656be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788642246.153386:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107398912 00000100:00100000:0.0:1788642246.153392:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107398912 00000100:00100000:0.0:1788642246.153421:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788642246.153427:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107398912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642246.155320:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107398912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1885us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642246.155333:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788642246.155377:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107398912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642246.155450:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107399040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642246.155494:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642246.155525:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc656be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642246.155581:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107399040 00000100:00100000:1.0:1788642246.155592:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107399040 00000100:00100000:1.0:1788642246.155637:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788642246.155646:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107399040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642246.155871:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107399040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642246.155878:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788642246.155960:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107399040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788642246.157733:0:11249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788642246.158043:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788642246.158063:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788642246.158075:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d263 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642246.158087:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d263 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642246.158145:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788642246.158149:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddc599b800 from 7 10000000:01000000:1.0:1788642246.158152:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788642246.158192:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642246.158200:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642246.158210:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642246.158235:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107399168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788642246.158308:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642246.158343:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788642246.158363:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107399168 00000100:00100000:1.0:1788642246.158377:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107399168 00000100:00100000:1.0:1788642246.158420:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788642246.158429:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107399168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788642246.158443:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642246.158456:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddcfb51000/0x4ae1ee156666d271 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d26a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642246.158478:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddcfb51000/0x4ae1ee156666d271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d26a expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642246.158489:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddcfb51000/0x4ae1ee156666d271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d26a expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642246.158498:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51000, rc 0) 00000100:00100000:1.0:1788642246.158531:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107399168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642246.158538:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788642246.158576:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107399168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788642246.158589:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d271 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642246.158598:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d271 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642246.158642:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107399296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642246.158666:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642246.158679:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788642246.158690:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107399296 00000100:00100000:1.0:1788642246.158699:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107399296 00000100:00100000:1.0:1788642246.158720:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788642246.158726:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107399296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642246.159068:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107399296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642246.159076:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788642246.159128:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107399296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642246.159151:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107399424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642246.159183:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642246.159200:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788642246.159211:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107399424 00000100:00100000:1.0:1788642246.159214:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107399424 00000100:00100000:1.0:1788642246.159231:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788642246.159236:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107399424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642246.159552:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107399424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 315us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642246.159559:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788642246.159590:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff83480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107399424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788642246.172398:0:11250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788642246.175618:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788642246.175651:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788642246.175664:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d271 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642246.175677:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d271 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642246.332313:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107399680:0@lo:400:kworker.0 00000100:00100000:1.0:1788642246.332361:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107399552:0@lo:400:kworker.0 00000100:00100000:2.0:1788642246.332406:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642246.332449:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642246.332479:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107400064:0@lo:400:kworker.0 00000100:00100000:2.0:1788642246.332488:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788642246.332498:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107399808:0@lo:400:kworker.0 00000100:00100000:1.0:1788642246.332510:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642246.332533:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642246.332545:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788642246.332554:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1875527107399936:0@lo:400:kworker.0 00000100:00100000:1.0:1788642246.332581:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642246.332591:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107399680 00000100:00100000:2.0:1788642246.332600:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107399680 00000100:00100000:1.0:1788642246.332615:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107400064 00000100:00100000:1.0:1788642246.332620:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107400064 00000100:00100000:2.0:1788642246.332667:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107399552 00000100:00100000:2.0:1788642246.332672:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107399552 00000100:00100000:1.0:1788642246.332677:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107399808 00000100:00100000:1.0:1788642246.332682:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107399808 00000100:00100000:2.0:1788642246.332693:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107399936 00000100:00100000:2.0:1788642246.332697:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107399936 00000100:00100000:1.0:1788642246.332712:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788642246.332721:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788642246.332727:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107400064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642246.332735:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107399680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642246.332790:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107400064:12345-0@lo:400:kworker.0 Request processed in 68us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642246.332810:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788642246.332827:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788642246.332833:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107399808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642246.332863:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788642246.332872:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107399680:12345-0@lo:400:kworker.0 Request processed in 141us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642246.332876:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107399552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642246.332876:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107399808:12345-0@lo:400:kworker.0 Request processed in 42us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642246.332888:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788642246.332888:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788642246.332918:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788642246.332920:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107399552:12345-0@lo:400:kworker.0 Request processed in 47us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642246.332933:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788642246.332934:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875527107399936:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788642246.332966:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788642246.332971:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788642246.332975:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642246.332976:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875527107399936:12345-0@lo:400:kworker.0 Request processed in 48us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642246.332984:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1875527107399936:0@lo:400:kworker.0 00000100:00100000:2.0:1788642246.332985:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788642246.333003:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107399552:0@lo:400:kworker.0 00010000:00080000:3.0:1788642246.333012:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad58a80 x1875527107399808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788642246.333013:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad58e00 x1875527107400064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642246.333026:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107399808:0@lo:400:kworker.0 00000100:00100000:1.0:1788642246.333030:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107400064:0@lo:400:kworker.0 00000100:00100000:2.0:1788642246.333310:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107399680:0@lo:400:kworker.0 00010000:00010000:0.0:1788642246.593813:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642246.847326:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107400192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788642246.847425:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642246.847520:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107400192 00000100:00100000:1.0:1788642246.847531:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107400192 00000100:00100000:1.0:1788642246.847606:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788642246.847616:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107400192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642246.847664:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642246.855964:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107400192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8337us (8526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642246.855980:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788642246.856261:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef9eed80 x1875527107400192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642246.856289:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107400192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788642247.610264:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642247.868479:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788642247.868506:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107400320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642247.868599:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642247.868721:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107400320 00000100:00100000:1.0:1788642247.868731:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107400320 00000100:00100000:1.0:1788642247.868795:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788642247.868807:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107400320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788642247.868851:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642247.868905:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107400320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642247.868913:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788642247.869017:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddeff81f80 x1875527107400320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642247.869037:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107400320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788642248.634226:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788642248.699624:0:11396:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788642249.658206:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642250.394793:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642250.394847:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642250.394877:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642250.395017:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086391168 00000100:00100000:2.0:1788642250.395027:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086391168 00000100:00100000:2.0:1788642250.395116:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 246 00000100:00100000:2.0:1788642250.395127:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086391168:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642250.395218:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086391168:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 92us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642250.395241:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 246 00000100:00100000:3.0:1788642250.395408:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086391424 00000100:00100000:3.0:1788642250.395423:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086391424 00000100:00100000:2.0:1788642250.412342:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086391296 00000100:00100000:2.0:1788642250.412362:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086391296 00000100:00100000:2.0:1788642250.412442:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 99 00000100:00100000:2.0:1788642250.412469:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086391424:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642250.412832:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086391424:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 377us (17981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642250.412841:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 99 00000100:00100000:2.0:1788642250.412865:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00100000:2.0:1788642250.412871:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086391296:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642250.412897:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086391296:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 26us (18019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642250.412902:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00080000:0.0:1788642250.417070:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788642250.692765:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642251.455952:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107400448:0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.456064:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642251.456153:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107400960:0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.456186:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642251.456234:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788642251.456241:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107400576:0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.456269:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642251.456289:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107401088:0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.456316:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642251.456352:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107400704:0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.456407:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642251.456431:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788642251.456437:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107400832:0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.456473:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642251.456516:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107400448 00000100:00100000:0.0:1788642251.456525:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107400448 00000100:00100000:0.0:1788642251.456585:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788642251.456595:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3319:x1875527107400448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.456655:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3319:x1875527107400448:12345-0@lo:400:kworker.0 Request processed in 61us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642251.456663:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788642251.456718:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107400960 00000100:00100000:0.0:1788642251.456723:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107400960 00000100:00100000:0.0:1788642251.456772:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107400576 00000100:00100000:0.0:1788642251.456776:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107400576 00000100:00100000:0.0:1788642251.456788:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107400704 00000100:00100000:0.0:1788642251.456790:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107400704 00000100:00100000:0.0:1788642251.456808:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788642251.456815:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107400960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.456851:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107400960:12345-0@lo:400:kworker.0 Request processed in 37us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642251.456859:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788642251.456871:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788642251.456877:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107400576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.456905:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107400576:12345-0@lo:400:kworker.0 Request processed in 29us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642251.456912:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788642251.456923:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788642251.456929:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107400704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.456962:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107400704:12345-0@lo:400:kworker.0 Request processed in 34us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642251.456976:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788642251.457001:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107401088 00000100:00100000:0.0:1788642251.457004:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107401088 00000100:00100000:0.0:1788642251.457031:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107400832 00000100:00100000:0.0:1788642251.457045:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107400832 00000100:00100000:0.0:1788642251.457067:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788642251.457073:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107401088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.457135:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107401088:12345-0@lo:400:kworker.0 Request processed in 61us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642251.457142:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788642251.457153:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788642251.457159:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107400832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.457186:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107400832:12345-0@lo:400:kworker.0 Request processed in 28us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642251.457192:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788642251.457226:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788642251.457231:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642251.457235:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788642251.457274:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfb4b6680 x1875527107400832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642251.457292:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107400832:0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.457308:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107400704:0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.457342:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107400576:0@lo:400:kworker.0 00010000:00080000:0.0:1788642251.457352:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfb4b7100 x1875527107401088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642251.457375:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107401088:0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.457388:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107400448:0@lo:400:kworker.0 00000100:00100000:0.0:1788642251.457399:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107400960:0@lo:400:kworker.0 00010000:00010000:0.0:1788642251.706682:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642251.962338:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107401216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788642251.962470:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642251.962591:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107401216 00000100:00100000:3.0:1788642251.962603:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107401216 00000100:00100000:3.0:1788642251.962681:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788642251.962692:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107401216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642251.962740:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642251.963004:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107401216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 313us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642251.963031:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788642251.963342:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfa8ece00 x1875527107401216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642251.963370:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107401216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788642252.740693:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642252.987237:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107401344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642252.987308:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642252.988181:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107401344 00000100:00100000:1.0:1788642252.988192:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107401344 00000100:00100000:1.0:1788642252.988243:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788642252.988252:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107401344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788642252.988293:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642252.988374:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107401344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642252.988381:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788642252.988432:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef17d180 x1875527107401344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642252.988769:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107401344:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788642253.182491:0:11496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 17:04:11 (1788642251) === 00000100:00100000:3.0:1788642253.471285:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642253.471404:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642253.472365:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086391552 00000100:00100000:0.0:1788642253.472384:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086391552 00000100:00100000:2.0:1788642253.476231:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086391680 00000100:00100000:2.0:1788642253.476250:0:5870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086391680 00000100:00100000:1.0:1788642253.476525:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:1.0:1788642253.476540:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2361:x1875527086391552:12345-192.168.202.49@tcp:41:mkdir.0 00000004:00000024:1.0:1788642253.476686:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788642253.476832:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2361:x1875527086391552:12345-192.168.202.49@tcp:41:mkdir.0 Request processed in 294us (5561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642253.476840:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788642253.480178:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:2.0:1788642253.480197:0:5870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:9703:x1875527086391680:12345-192.168.202.49@tcp:700:mkdir.0 00000100:00100000:0.0:1788642253.480206:0:5871:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:0.0:1788642253.480227:0:5871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:2.0:1788642253.480314:0:5870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:9703:x1875527086391680:12345-192.168.202.49@tcp:700:mkdir.0 Request processed in 123us (8909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642253.480322:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00080000:3.0:1788642253.480424:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642253.483031:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642253.483126:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086391936 00000100:00100000:0.0:1788642253.483140:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086391936 00000100:00100000:0.0:1788642253.483426:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:0.0:1788642253.483442:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:9703:x1875527086391936:12345-192.168.202.49@tcp:36:mkdir.0 00010000:00010000:0.0:1788642253.483533:0:9441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642253.489226:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d159 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96ac expref: 6 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.489267:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde02b5900) 00010000:00010000:0.0:1788642253.489297:0:9441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788642253.490191:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d278 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.490221:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d278 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.490238:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d278 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.492526:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d27f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.492562:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d27f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.492580:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d27f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642253.494526:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788642253.494545:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d278 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.494556:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d278 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.494564:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d278 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.494570:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642253.494575:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d278 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.494583:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d278 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.494600:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365ff00) 00010000:00010000:1.0:1788642253.494603:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642253.494608:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d278 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.494616:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d278 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788642253.494646:0:9441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003db07460 reply state 00000000fba7a9da transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d27f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642253.494654:0:9441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788642253.494848:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:9703:x1875527086391936:12345-192.168.202.49@tcp:36:mkdir.0 Request processed in 11407us (11826us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788642253.494866:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00010000:00010000:2.0:1788642253.500903:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d27f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.500931:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d27f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.500962:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d27f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.500969:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51a00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642253.500976:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d27f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.500986:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d27f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.501015:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dddc365fb00) 00010000:00010000:2.0:1788642253.501018:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642253.501025:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d27f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.501032:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d27f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642253.516450:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642253.517053:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086392064 00000100:00100000:1.0:1788642253.517066:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086392064 00000100:00100000:1.0:1788642253.517763:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:1.0:1788642253.517778:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:9704:x1875527086392064:12345-192.168.202.49@tcp:101:chmod.0 00010000:00010000:1.0:1788642253.517810:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642253.517840:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d286 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9731 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.518311:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d28d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.518329:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d28d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.518342:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d28d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642253.518452:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788642253.518457:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642253.518510:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d28d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.518616:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d286 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9731 expref: 8 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.518702:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d28d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9731 expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.518742:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365ff00) 00010000:00010000:1.0:1788642253.518746:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788642253.518750:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51600, rc 0) 00000100:00100000:1.0:1788642253.518893:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:9704:x1875527086392064:12345-192.168.202.49@tcp:101:chmod.0 Request processed in 1118us (2453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642253.518902:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:0.0:1788642253.521842:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642253.521930:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086392320 00000100:00100000:3.0:1788642253.521944:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086392320 00000100:00100000:3.0:1788642253.522058:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:3.0:1788642253.522071:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:9704:x1875527086392320:12345-192.168.202.49@tcp:36:chmod.0 00010000:00010000:3.0:1788642253.522181:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642253.522216:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d28d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9731 expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.522240:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365ff00) 00010000:00010000:3.0:1788642253.522263:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642253.522298:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d294 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.522316:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d294 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.522330:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d294 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788642253.522886:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080244ddc reply state 00000000b178d814 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d294 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642253.522898:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788642253.522909:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788642253.523034:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:9704:x1875527086392320:12345-192.168.202.49@tcp:36:chmod.0 Request processed in 965us (1206us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788642253.523041:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00010000:00010000:3.0:1788642253.525640:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d294 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.525663:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d294 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.525672:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d294 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.525678:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642253.525683:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d294 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.525692:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d294 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.525716:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:3.0:1788642253.525719:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788642253.525734:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d294 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.525742:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d294 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642253.552488:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642253.552625:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086392448 00000100:00100000:1.0:1788642253.552640:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086392448 00000100:00100000:1.0:1788642253.552738:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:1.0:1788642253.552751:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:9705:x1875527086392448:12345-192.168.202.49@tcp:101:chown.0 00010000:00010000:1.0:1788642253.552785:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642253.552820:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d29b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9738 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.552915:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d2a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.552933:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.552950:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642253.552996:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788642253.553001:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642253.553050:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d2a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.553147:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d29b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9738 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.553172:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d2a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9738 expref: 8 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.553183:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fd00) 00010000:00010000:1.0:1788642253.553187:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788642253.553192:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51600, rc 0) 00000100:00100000:1.0:1788642253.553277:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:9705:x1875527086392448:12345-192.168.202.49@tcp:101:chown.0 Request processed in 528us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642253.553285:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:1.0:1788642253.555828:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642253.555937:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086392576 00000100:00100000:0.0:1788642253.555972:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086392576 00000100:00100000:0.0:1788642253.556053:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:0.0:1788642253.556066:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:9705:x1875527086392576:12345-192.168.202.49@tcp:101:chown.0 00010000:00010000:0.0:1788642253.556136:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642253.556164:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d2a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a973f expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556265:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d2b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556283:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d2b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556298:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d2b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556315:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d2b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556322:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556328:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556469:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d2be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556477:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556483:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642253.556529:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788642253.556534:0:9441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788642253.556610:0:9441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556626:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d2b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556634:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d2b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556642:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d2b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556648:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642253.556653:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d2b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556662:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d2b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556676:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fd00) 00010000:00010000:0.0:1788642253.556679:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642253.556685:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d2b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556691:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d2b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556708:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556738:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d2b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556744:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556749:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121a00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642253.556753:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556759:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d2b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556767:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ddde00fb700) 00010000:00010000:0.0:1788642253.556770:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642253.556773:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d2b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556780:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d2b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556821:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d2a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a973f expref: 10 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556839:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d2be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a973f expref: 9 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.556847:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:0.0:1788642253.556850:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788642253.556860:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121600, rc 0) 00000100:00100000:0.0:1788642253.556952:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:9705:x1875527086392576:12345-192.168.202.49@tcp:101:chown.0 Request processed in 887us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642253.556962:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:0.0:1788642253.564534:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642253.564667:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086392832 00000100:00100000:3.0:1788642253.564693:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086392832 00000100:00100000:3.0:1788642253.564836:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:3.0:1788642253.564849:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:9705:x1875527086392832:12345-192.168.202.49@tcp:36:chown.0 00010000:00010000:3.0:1788642253.564936:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642253.564989:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d2be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a973f expref: 9 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.565019:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:3.0:1788642253.565037:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642253.565089:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.565129:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.565143:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788642253.678783:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1788642253.678827:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1788642253.678972:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afe78515 reply state 000000005ee69341 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642253.678995:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788642253.679016:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1788642253.679191:0:5861:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788642253.679210:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:9705:x1875527086392832:12345-192.168.202.49@tcp:36:chown.0 Request processed in 114359us (114692us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788642253.679219:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00010000:00010000:2.0:1788642253.679510:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.679525:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.679534:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.679540:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642253.679546:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.679574:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.679595:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:2.0:1788642253.679599:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788642253.679605:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.679612:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642253.720394:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642253.720547:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086392960 00000100:00100000:3.0:1788642253.720562:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086392960 00000100:00100000:3.0:1788642253.720650:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:3.0:1788642253.720664:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:9706:x1875527086392960:12345-192.168.202.49@tcp:101:touch.500 00010000:00010000:3.0:1788642253.720712:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642253.720744:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d2cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9746 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788642253.725203:0:5862:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4384us 00010000:00010000:3.0:1788642253.743436:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d2d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.743481:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d2d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.743498:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d2d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.743519:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d2da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.743528:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d2da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.743534:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d2da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.743929:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744487:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744503:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642253.744537:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788642253.744542:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642253.744592:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744607:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d2d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744625:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d2d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744632:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d2d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744639:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031e00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642253.744644:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d2d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744653:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d2d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744669:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fd00) 00010000:00010000:3.0:1788642253.744672:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642253.744679:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d2d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744685:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d2d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744715:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d2da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744722:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d2da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744728:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d2da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744733:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642253.744743:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d2da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744750:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d2da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744758:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642253.744761:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642253.744764:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d2da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744770:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d2da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744822:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d2cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9746 expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744838:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9746 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.744846:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:3.0:1788642253.744848:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788642253.744851:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031400, rc 0) 00000100:00100000:3.0:1788642253.745175:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:9706:x1875527086392960:12345-192.168.202.49@tcp:101:touch.500 Request processed in 24511us (24793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642253.745187:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:2.0:1788642253.752315:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642253.752882:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086393216 00000100:00100000:1.0:1788642253.752899:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086393216 00000100:00100000:1.0:1788642253.752984:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:1.0:1788642253.752994:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:9706:x1875527086393216:12345-192.168.202.49@tcp:101:touch.500 00010000:00010000:1.0:1788642253.753015:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642253.753053:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d2e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a974d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.753491:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51800/0x4ae1ee156666d2ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.753507:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51800/0x4ae1ee156666d2ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.753519:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51800/0x4ae1ee156666d2ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.753576:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d2f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.753585:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.753592:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788642253.754476:0:5863:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788642253.754584:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642253.755322:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51400/0x4ae1ee156666d2fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.755338:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51400/0x4ae1ee156666d2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.755347:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51400/0x4ae1ee156666d2fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.755378:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51800/0x4ae1ee156666d2ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.755394:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51800/0x4ae1ee156666d2ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.755401:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51800/0x4ae1ee156666d2ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.755406:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642253.755410:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51800/0x4ae1ee156666d2ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.755418:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51800/0x4ae1ee156666d2ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.755427:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:1.0:1788642253.755430:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642253.755434:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51800/0x4ae1ee156666d2ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.755440:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51800/0x4ae1ee156666d2ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788642253.755452:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000daa0c4a5 reply state 000000009b60f2b2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642253.755459:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788642253.755492:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51a00/0x4ae1ee156666d2e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a974d expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.755505:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51400/0x4ae1ee156666d2fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a974d expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.755523:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dddc365f500) 00010000:00010000:1.0:1788642253.755525:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642253.755528:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51400, rc 0) 00000100:00100000:1.0:1788642253.755629:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:9706:x1875527086393216:12345-192.168.202.49@tcp:101:touch.500 Request processed in 2637us (3332us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788642253.755635:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:1.0:1788642253.766458:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:3.0:1788642253.766605:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.766617:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d2f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.766638:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d2f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.766644:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50c00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642253.766650:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d2f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.766658:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d2f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.766674:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x279c6b5 (ffff8dddc365f700) 00010000:00010000:3.0:1788642253.766678:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642253.766699:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d2f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.766706:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d2f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642253.770200:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086393472 00000100:00100000:0.0:1788642253.770224:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086393472 00000100:00100000:0.0:1788642253.770332:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:0.0:1788642253.770345:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:9706:x1875527086393472:12345-192.168.202.49@tcp:36:touch.500 00010000:00010000:0.0:1788642253.770433:0:9441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642253.770467:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51400/0x4ae1ee156666d2fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a974d expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.770490:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dddc365f500) 00010000:00010000:0.0:1788642253.770511:0:9441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642253.770569:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d30b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.770584:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d30b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.770596:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d30b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788642253.770797:0:9441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097224055 reply state 00000000dad78be5 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d30b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642253.770836:0:9441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788642253.771452:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:9706:x1875527086393472:12345-192.168.202.49@tcp:36:touch.500 Request processed in 1099us (4994us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788642253.771464:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 23 00010000:00010000:2.0:1788642253.775674:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d30b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.775704:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d30b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.775712:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d30b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.775719:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6120200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642253.775725:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d30b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.775733:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d30b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.775752:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ddde00fb700) 00010000:00010000:2.0:1788642253.775755:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642253.775777:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d30b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642253.775784:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d30b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642253.778730:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642253.779756:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086393600 00000100:00100000:3.0:1788642253.779771:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086393600 00000100:00100000:3.0:1788642253.779840:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:3.0:1788642253.779851:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:9706:x1875527086393600:12345-192.168.202.49@tcp:101:touch.500 00010000:00010000:3.0:1788642253.779877:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642253.779900:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d312 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9754 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.779966:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9754 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.780003:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9754 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.780025:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642253.780028:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788642253.780032:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031600, rc 0) 00000100:00100000:3.0:1788642253.780124:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:9706:x1875527086393600:12345-192.168.202.49@tcp:101:touch.500 Request processed in 274us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642253.780131:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:3.0:1788642253.785244:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642253.785475:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086393728 00000100:00100000:0.0:1788642253.785486:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086393728 00000100:00100000:0.0:1788642253.785533:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:0.0:1788642253.785542:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875527086393728:12345-192.168.202.49@tcp:8:touch.500 00010000:00080000:0.0:1788642253.785577:0:9442:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp t0 exp 0000000000000000 cur 341 last 0 00000020:00000080:0.0:1788642253.785610:0:9442:0:(genops.c:1385:class_connect()) connect: client e32b659c-dd8d-40c5-94b4-b9b0e719a356, cookie 0x4ae1ee156666d319 00002000:00100000:0.0:1788642253.785622:0:9442:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e32b659c-dd8d-40c5-94b4-b9b0e719a356/ffff8ddcc58d7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788642253.785645:0:9442:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788642253.785996:0:9442:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788642253.786035:0:9442:0:(import.c:65:import_set_state_nolock()) ffff8ddcc58d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788642253.786615:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2358:x1875527086393728:12345-192.168.202.49@tcp:8:touch.500 Request processed in 1068us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642253.786624:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:0.0:1788642253.792484:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642253.792636:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086393856 00000100:00100000:3.0:1788642253.792646:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086393856 00000100:00100000:3.0:1788642253.792740:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:3.0:1788642253.792750:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:0:x1875527086393856:12345-192.168.202.49@tcp:2:touch.500 00000100:00080000:0.0:1788642253.793327:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788642253.841036:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:0:x1875527086393856:12345-192.168.202.49@tcp:2:touch.500 Request processed in 48276us (48552us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788642253.841051:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00000001:00100000:2.0:1788642253.841637:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000001:00080000:2.0:1788642253.841659:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1788642253.844315:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642253.844389:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086394112 00000100:00100000:0.0:1788642253.844398:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086394112 00000100:00100000:0.0:1788642253.844454:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:0.0:1788642253.844461:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:9706:x1875527086394112:12345-192.168.202.49@tcp:35:touch.500 00000100:00100000:0.0:1788642253.844837:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+11:9706:x1875527086394112:12345-192.168.202.49@tcp:35:touch.500 Request processed in 374us (530us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788642253.844858:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:3.0:1788642253.871448:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642253.871509:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086394240 00000100:00100000:0.0:1788642253.871518:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086394240 00000100:00100000:0.0:1788642253.871572:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:0.0:1788642253.871579:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+11:9707:x1875527086394240:12345-192.168.202.49@tcp:101:rm.0 00010000:00010000:0.0:1788642253.871601:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642253.871619:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d320 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a975b expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.871684:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d327 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.871700:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.871717:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642253.871754:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788642253.871757:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788642253.871796:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.871822:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d320 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a975b expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.871839:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a975b expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.871870:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:0.0:1788642253.871872:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788642253.871876:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121e00, rc 0) 00000100:00100000:0.0:1788642253.871980:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+12:9707:x1875527086394240:12345-192.168.202.49@tcp:101:rm.0 Request processed in 400us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642253.871987:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:2.0:1788642253.886155:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642253.886356:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086394496 00000100:00100000:3.0:1788642253.886369:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086394496 00000100:00100000:3.0:1788642253.886433:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:3.0:1788642253.886443:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+12:9707:x1875527086394496:12345-192.168.202.49@tcp:101:rm.0 00010000:00010000:3.0:1788642253.886464:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642253.886487:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d32e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9762 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642253.886589:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788642253.886997:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d32e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9762 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.887019:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fd00) 00010000:00010000:3.0:1788642253.887021:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788642253.887027:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d32e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9762 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.887043:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031200, rc 0) 00000100:00100000:3.0:1788642253.887211:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:9707:x1875527086394496:12345-192.168.202.49@tcp:101:rm.0 Request processed in 769us (1112us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788642253.887219:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:3.0:1788642253.894659:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642253.894916:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086394624 00000100:00100000:1.0:1788642253.894926:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086394624 00000100:00100000:1.0:1788642253.895026:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:1.0:1788642253.895036:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:9707:x1875527086394624:12345-192.168.202.49@tcp:37:rm.0 00000100:00100000:3.0:1788642253.900643:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:9707:x1875527086394624:12345-192.168.202.49@tcp:37:rm.0 Request processed in 5599us (5982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642253.900657:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:2.0:1788642253.919948:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642253.920029:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086394880 00000100:00100000:0.0:1788642253.920039:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086394880 00000100:00100000:0.0:1788642253.920094:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:0.0:1788642253.920183:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddddbdcd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:9707:x1875527086394880:12345-192.168.202.49@tcp:35:rm.0 00000100:00100000:0.0:1788642253.920435:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddddbdcd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:9707:x1875527086394880:12345-192.168.202.49@tcp:35:rm.0 Request processed in 316us (498us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788642253.920443:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:1.0:1788642253.923557:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642253.923659:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086395136 00000100:00100000:0.0:1788642253.923680:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086395136 00000100:00100000:0.0:1788642253.923900:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:0.0:1788642253.923910:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:9707:x1875527086395136:12345-192.168.202.49@tcp:101:rm.0 00010000:00010000:0.0:1788642253.923931:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642253.923950:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d33c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9769 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.924035:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d343 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.924049:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d343 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.924083:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d343 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642253.924094:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788642253.924248:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d33c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9769 expref: 17 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.924266:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d343 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9769 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642253.924275:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:0.0:1788642253.924278:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788642253.924281:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6120200, rc 0) 00000100:00100000:0.0:1788642253.924434:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:9707:x1875527086395136:12345-192.168.202.49@tcp:101:rm.0 Request processed in 525us (884us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788642253.924441:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:1.0:1788642253.942023:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642253.944999:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086395264 00000100:00100000:2.0:1788642253.945015:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086395264 00000100:00100000:2.0:1788642253.945133:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:2.0:1788642253.945145:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:9707:x1875527086395264:12345-192.168.202.49@tcp:41:rm.0 00000004:00000024:2.0:1788642253.945231:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788642253.945330:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:9707:x1875527086395264:12345-192.168.202.49@tcp:41:rm.0 Request processed in 188us (3322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642253.945337:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:2.0:1788642253.961784:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642253.961943:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086395392 00000100:00100000:1.0:1788642253.961954:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086395392 00000100:00100000:1.0:1788642253.962020:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:1.0:1788642253.962030:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:9707:x1875527086395392:12345-192.168.202.49@tcp:101:rm.0 00010000:00010000:1.0:1788642253.962051:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642253.962087:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d351 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9770 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962192:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50000/0x4ae1ee156666d358 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962220:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50000/0x4ae1ee156666d358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962232:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50000/0x4ae1ee156666d358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962247:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d35f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962254:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962260:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962396:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962404:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962410:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642253.962437:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788642253.962441:0:9441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642253.962463:0:9441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962477:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962495:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50000/0x4ae1ee156666d358 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962503:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50000/0x4ae1ee156666d358 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962509:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50000/0x4ae1ee156666d358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962515:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642253.962520:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50000/0x4ae1ee156666d358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962528:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50000/0x4ae1ee156666d358 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962541:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:1.0:1788642253.962544:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642253.962549:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50000/0x4ae1ee156666d358 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962554:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50000/0x4ae1ee156666d358 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962568:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d35f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962575:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d35f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962581:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d35f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962594:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642253.962596:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d35f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962602:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d35f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962610:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x279c6b5 (ffff8dddc365f400) 00010000:00010000:1.0:1788642253.962612:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642253.962615:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d35f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962621:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d35f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962670:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d351 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9770 expref: 18 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.962684:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9770 expref: 17 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.963700:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:1.0:1788642253.963703:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642253.963706:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51200, rc 0) 00000100:00100000:1.0:1788642253.963809:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+17:9707:x1875527086395392:12345-192.168.202.49@tcp:101:rm.0 Request processed in 1777us (2032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642253.963818:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:1.0:1788642253.972614:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642253.972722:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086395648 00000100:00100000:3.0:1788642253.972731:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086395648 00000100:00100000:3.0:1788642253.972781:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:3.0:1788642253.972791:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+17:9707:x1875527086395648:12345-192.168.202.49@tcp:36:rm.0 00010000:00010000:3.0:1788642253.972852:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788642253.972884:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d366 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9770 expref: 17 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.972907:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d312 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9754 expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.972925:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642253.972953:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d327 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a975b expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.972962:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:3.0:1788642253.972965:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642253.972986:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d36d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.973000:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d36d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.973010:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d36d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.973026:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d374 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.973033:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.973039:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.973186:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d37b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.973195:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d37b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.973202:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d37b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788642253.973977:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788642253.973996:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341434897162ns, next at 342434893734ns, rc = 0 00010000:00010000:3.0:1788642253.974072:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8e00/0x4ae1ee156666d382 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974085:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8e00/0x4ae1ee156666d382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974094:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8e00/0x4ae1ee156666d382 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974129:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8e00/0x4ae1ee156666d382 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974136:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8e00/0x4ae1ee156666d382 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974142:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8e00/0x4ae1ee156666d382 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974167:0:5861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788642253.974189:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d37b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974196:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d37b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974203:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d37b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974208:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9832a00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642253.974212:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d37b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974231:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d37b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974243:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ddde02b5400) 00010000:00010000:3.0:1788642253.974246:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788642253.974250:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d37b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974257:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d37b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974274:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d36d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974279:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d36d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974284:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d36d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974288:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642253.974291:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d36d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974297:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d36d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974305:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:3.0:1788642253.974307:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642253.974310:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d36d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.974326:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d36d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788642253.974338:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017e15f92 reply state 000000005375cf50 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642253.974347:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788642253.974427:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:9707:x1875527086395648:12345-192.168.202.49@tcp:36:rm.0 Request processed in 1634us (1820us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788642253.974436:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 30 00010000:00010000:1.0:1788642253.975090:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642253.975122:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8e00/0x4ae1ee156666d382 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.975130:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f8e00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642253.975134:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8e00/0x4ae1ee156666d382 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.975141:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8e00/0x4ae1ee156666d382 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.975153:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ddde02b5400) 00010000:00010000:1.0:1788642253.975156:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788642253.975159:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8e00/0x4ae1ee156666d382 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.975166:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8e00/0x4ae1ee156666d382 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642253.975186:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642253.975188:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642253.975189:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642253.980638:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.980672:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d374 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.980685:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d374 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.980691:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031e00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642253.980698:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d374 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.980708:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d374 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.980732:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x279c6b5 (ffff8ddde02b5700) 00010000:00010000:3.0:1788642253.980736:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642253.980742:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d374 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642253.980775:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d374 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x279c6b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642253.990232:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642253.990958:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086395904 00000100:00100000:3.0:1788642253.990981:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086395904 00000100:00100000:3.0:1788642253.991080:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:3.0:1788642253.991091:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:9707:x1875527086395904:12345-192.168.202.49@tcp:35:rm.0 00000100:00100000:3.0:1788642253.992700:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:9707:x1875527086395904:12345-192.168.202.49@tcp:35:rm.0 Request processed in 1596us (2464us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788642253.992717:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:2.0:1788642254.004433:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642254.004542:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086396160 00000100:00100000:0.0:1788642254.004553:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086396160 00000100:00100000:0.0:1788642254.005581:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:0.0:1788642254.005598:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:9707:x1875527086396160:12345-192.168.202.49@tcp:36:rm.0 00010000:00010000:0.0:1788642254.005679:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788642254.005710:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d343 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9769 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.005736:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d2e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9746 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.005783:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:0.0:1788642254.005802:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d2a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9738 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.005811:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fd00) 00010000:00010000:0.0:1788642254.005824:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642254.005847:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d389 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.005860:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d389 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.005868:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d389 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.005880:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d390 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.005887:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d390 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.005892:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d390 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.006613:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d397 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.006625:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d397 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.006645:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d397 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642254.013527:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788642254.013552:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d397 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.013562:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d397 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.013570:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d397 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.013576:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642254.013580:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d397 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.013588:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d397 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.013603:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ddde00fb700) 00010000:00010000:0.0:1788642254.013606:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788642254.013611:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d397 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.013617:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d397 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.013643:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d389 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.013650:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d389 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.013677:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d389 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.014371:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642254.014375:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d389 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.014382:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d389 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.014393:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb600) 00010000:00010000:0.0:1788642254.014396:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642254.014399:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d389 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.014405:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d389 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788642254.014424:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a725b60 reply state 00000000df1f9b21 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d390 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642254.014433:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788642254.014574:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:9707:x1875527086396160:12345-192.168.202.49@tcp:36:rm.0 Request processed in 8977us (10149us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788642254.014584:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 31 00010000:00010000:0.0:1788642254.019600:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d390 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.019621:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d390 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.019647:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d390 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.019666:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121a00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642254.019670:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d390 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.019686:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d390 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.019704:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ddde00fb200) 00010000:00010000:0.0:1788642254.019707:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642254.019712:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d390 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642254.019718:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121a00/0x4ae1ee156666d390 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642254.781322:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642255.515324:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642255.515350:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642255.515383:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642255.515447:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642255.515487:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086396288 00000100:00100000:2.0:1788642255.515500:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086396288 00000100:00100000:2.0:1788642255.515573:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 248 00000100:00100000:2.0:1788642255.515591:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086396288:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642255.515667:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086396288:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 78us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642255.515675:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 248 00000100:00100000:2.0:1788642255.515712:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086396544 00000100:00100000:2.0:1788642255.515717:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086396544 00000100:00100000:2.0:1788642255.515757:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:2.0:1788642255.515764:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086396544:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642255.515793:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086396544:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 30us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642255.515799:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00080000:2.0:1788642255.516084:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788642255.516226:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086396416 00000100:00100000:3.0:1788642255.516232:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086396416 00000100:00100000:3.0:1788642255.516283:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086396672 00000100:00100000:3.0:1788642255.516287:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086396672 00000100:00100000:3.0:1788642255.516309:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 104 00000100:00100000:3.0:1788642255.516316:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:2360:x1875527086396416:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642255.516365:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:2360:x1875527086396416:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 49us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642255.516372:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 104 00000100:00100000:3.0:1788642255.516386:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 105 00000100:00100000:3.0:1788642255.516392:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086396672:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642255.516415:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086396672:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 24us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642255.516420:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 105 00000100:00080000:2.0:1788642255.518654:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788642255.806435:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642256.572829:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107401472:0@lo:400:kworker.0 00000100:00100000:0.0:1788642256.572829:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107401600:0@lo:400:kworker.0 00000100:00100000:0.0:1788642256.573223:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642256.573300:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107402112:0@lo:400:kworker.0 00000100:00100000:0.0:1788642256.573329:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642256.573372:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107401728:0@lo:400:kworker.0 00000100:00100000:0.0:1788642256.573395:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642256.573414:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788642256.573419:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107401856:0@lo:400:kworker.0 00000100:00100000:0.0:1788642256.573441:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642256.573483:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107401600 00000100:00100000:0.0:1788642256.573491:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107401600 00000100:00100000:0.0:1788642256.573533:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107401728 00000100:00100000:0.0:1788642256.573537:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107401728 00000100:00100000:0.0:1788642256.573570:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788642256.573579:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107401600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642256.573629:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642256.573629:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107401600:12345-0@lo:400:kworker.0 Request processed in 51us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642256.573636:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788642256.573652:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107401984:0@lo:400:kworker.0 00000100:00100000:0.0:1788642256.573652:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788642256.573658:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107401728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642256.573674:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642256.573685:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107401728:12345-0@lo:400:kworker.0 Request processed in 28us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642256.573691:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788642256.573699:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107401984 00000100:00100000:1.0:1788642256.573700:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107402112 00000100:00100000:0.0:1788642256.573702:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107401984 00000100:00100000:1.0:1788642256.573703:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107402112 00000100:00100000:0.0:1788642256.573732:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788642256.573738:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107401984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642256.573770:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107401984:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642256.573777:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788642256.573788:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107401856 00000100:00100000:1.0:1788642256.573797:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107401856 00000100:00100000:0.0:1788642256.573815:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107401728:0@lo:400:kworker.0 00000100:00100000:1.0:1788642256.573821:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788642256.573827:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107402112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642256.573842:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107401600:0@lo:400:kworker.0 00000100:00100000:1.0:1788642256.573858:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107402112:12345-0@lo:400:kworker.0 Request processed in 31us (528us total) trans 0 rc 0/0 00010000:00080000:0.0:1788642256.573862:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfa8ef800 x1875527107402112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642256.573864:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788642256.573872:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107402112:0@lo:400:kworker.0 00000100:00100000:1.0:1788642256.573875:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788642256.573880:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107401856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642256.573908:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107401856:12345-0@lo:400:kworker.0 Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642256.573914:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788642256.573934:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107401472 00000100:00100000:1.0:1788642256.573937:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107401472 00000100:00100000:1.0:1788642256.574053:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788642256.574163:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3319:x1875527107401472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642256.574197:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3319:x1875527107401472:12345-0@lo:400:kworker.0 Request processed in 138us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642256.574204:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00080000:1.0:1788642256.574251:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfa8eca80 x1875527107401856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642256.574261:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107401856:0@lo:400:kworker.0 00000100:00100000:1.0:1788642256.574296:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107401472:0@lo:400:kworker.0 00000100:00100000:1.0:1788642256.574306:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107401984:0@lo:400:kworker.0 00000100:00080000:2.0:1788642256.574693:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788642256.574699:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788642256.574702:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788642256.827175:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788642257.082346:0:7961:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344543243735ns, next at 345543240933ns, rc = 0 00000100:00100000:1.0:1788642257.082438:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107402240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788642257.082512:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642257.082614:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107402240 00000100:00100000:3.0:1788642257.082629:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107402240 00000100:00100000:3.0:1788642257.082682:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788642257.082692:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107402240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642257.082728:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642257.082889:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107402240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 197us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642257.082897:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788642257.083053:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfa8ef800 x1875527107402240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642257.083184:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107402240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788642257.850684:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642258.107028:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107402368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788642258.107156:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642258.107288:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107402368 00000100:00100000:1.0:1788642258.107297:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107402368 00000100:00100000:1.0:1788642258.107366:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788642258.107377:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107402368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788642258.107413:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642258.107473:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107402368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642258.107480:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788642258.107526:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfacf1c00 x1875527107402368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642258.107544:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107402368:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788642258.107675:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788642258.626935:0:11646:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:1.0:1788642258.744273:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788642258.744308:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788642258.744337:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788642258.744769:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107402496:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788642258.744855:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642258.745158:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107402496 00000100:00100000:1.0:1788642258.745166:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107402496 00000100:00100000:1.0:1788642258.745231:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788642258.745242:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107402496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788642258.745272:0:6711:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788642258.745310:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9c83cd, atime: 0x6a9c83cd, ctime: 0x6a9c83cd, blocks: 0x1 00010000:00010000:1.0:1788642258.745318:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a47cc07/0x4ae1ee156666d39e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642258.745337:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1788642258.745342:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642258.745349:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a47cc07/0x4ae1ee156666d39e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642258.745368:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a47cc07/0x4ae1ee156666d39e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642258.745390:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a47cc07/0x4ae1ee156666d39e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642258.745411:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a47cc07/0x4ae1ee156666d39e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642258.745430:0:6711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788642258.748813:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875527107402496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3565us (3950us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788642258.748828:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788642258.748866:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788642258.748882:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642258.748890:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a47cc07/0x4ae1ee156666d39e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642258.748901:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50400 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642258.748906:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a47cc07/0x4ae1ee156666d39e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642258.748917:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a47cc07/0x4ae1ee156666d39e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642258.748937:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a47cc07/0x4ae1ee156666d39e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642258.748968:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a47cc07/0x4ae1ee156666d39e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642258.748994:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642258.748996:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642258.748998:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788642258.751289:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dddeff81500/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788642258.751307:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107402496:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788642258.874499:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788642259.212707:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1788642259.910745:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788642260.306601:0:11696:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff01f7d380 20000000:00000080:3.0:1788642260.306623:0:11696:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dddfaec8000 uarg=0000000000000000 20000000:01000000:3.0:1788642260.306665:0:11696:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788642260.306751:0:11696:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788642260.306757:0:11696:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788642260.307578:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788642260.308042:0:11696:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788642260.313534:0:11696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788642260.313594:0:11696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788642260.313650:0:11696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788642260.313669:0:11696:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788642260.313692:0:11696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.313724:0:11696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc0031000/0x4ae1ee156666d240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9723 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.313734:0:11696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d247 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a972a expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.313754:0:11696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc9833200/0x4ae1ee156666d255 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d24e expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.313761:0:11696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666d263 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d25c expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.313767:0:11696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddcfb51000/0x4ae1ee156666d271 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d26a expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.313773:0:11696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.313814:0:11696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddcfb51000/0x4ae1ee156666d271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d26a expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.313829:0:11696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddcfb51000/0x4ae1ee156666d271 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d26a expref: 18 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642260.313844:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1875527107402624:0@lo:104: 00000100:00100000:3.0:1788642260.313910:0:11696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788642260.314092:0:11696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666d263 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d25c expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.314126:0:11696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666d263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d25c expref: 18 pid: 5854 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642260.314135:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1875527107402752:0@lo:104: 00000100:00100000:3.0:1788642260.314159:0:11696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788642260.316633:0:11696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc9833200/0x4ae1ee156666d255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666d24e expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.316662:0:11696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dddc9833200/0x4ae1ee156666d255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666d24e expref: 18 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642260.316679:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef153480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1875527107402880:0@lo:104: 00000100:00100000:3.0:1788642260.316746:0:11696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642260.316803:0:7656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107402624 00000100:00100000:1.0:1788642260.316812:0:7656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107402624 00000100:00100000:0.0:1788642260.316917:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107402752 00000100:00100000:0.0:1788642260.316922:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107402752 00000100:00100000:0.0:1788642260.317052:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788642260.317062:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:11696:x1875527107402624:12345-0@lo:104: 00010000:00010000:0.0:1788642260.317075:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d271 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317147:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788642260.317154:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+4:11696:x1875527107402624:12345-0@lo:104: Request processed in 94us (3244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642260.317161:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788642260.317178:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788642260.317184:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:11696:x1875527107402752:12345-0@lo:104: 00010000:00010000:0.0:1788642260.317192:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d263 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317224:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788642260.317236:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:11696:x1875527107402752:12345-0@lo:104: Request processed in 52us (3076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642260.317243:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788642260.317264:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788642260.317271:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d271 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317279:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50200 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642260.317283:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d271 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317293:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d271 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642260.317301:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d271 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642260.317307:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788642260.317335:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d271 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317341:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642260.317436:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d271 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317444:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50200/0x4ae1ee156666d26a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d271 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317458:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642260.317461:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d263 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317478:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0030c00 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642260.317481:0:5848:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d263 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317488:0:5848:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d263 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642260.317495:0:5848:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d263 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642260.317501:0:5848:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788642260.317515:0:5848:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d263 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317521:0:5848:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642260.317536:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d263 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317543:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddc0030c00/0x4ae1ee156666d25c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d263 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317554:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642260.317556:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642260.317558:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642260.317564:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642260.317576:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107403008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642260.317605:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642260.317644:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107403136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642260.317679:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642260.317725:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107403008 00000100:00100000:0.0:1788642260.317730:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107403008 00010000:00010000:0.0:1788642260.317748:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddcfb51000/0x4ae1ee156666d271 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d26a expref: 19 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642260.317768:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107403136 00000100:00100000:0.0:1788642260.317771:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107403136 00010000:00010000:0.0:1788642260.317782:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666d263 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d25c expref: 20 pid: 5854 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642260.317794:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788642260.317799:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+20:3320:x1875527107403008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642260.317811:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642260.317817:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddcfb51000/0x4ae1ee156666d271 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d26a expref: 20 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317829:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddcfb51000/0x4ae1ee156666d271 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d26a expref: 20 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317846:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642260.317874:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+20:3320:x1875527107403008:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642260.317880:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788642260.317895:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788642260.317900:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107403136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642260.317907:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642260.317912:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666d263 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d25c expref: 19 pid: 5854 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317931:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666d263 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d25c expref: 19 pid: 5854 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.317941:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642260.318251:0:11696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a972a expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.318266:0:11696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d247 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a972a expref: 12 pid: 5854 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642260.318278:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef151f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1875527107403264:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788642260.318475:0:11696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddc0031000/0x4ae1ee156666d240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9723 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.318485:0:11696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddc0031000/0x4ae1ee156666d240 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9723 expref: 12 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642260.318494:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1875527107403392:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642260.318527:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5f600 going to sleep for 11 seconds 00010000:00010000:3.0:1788642260.318551:0:11696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddcfb51000/0x4ae1ee156666d271 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d26a expref: 19 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642260.318563:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1875527107402624:0@lo:104: 00010000:00010000:3.0:1788642260.318573:0:11696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9833400/0x4ae1ee156666d263 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d25c expref: 18 pid: 5854 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642260.318593:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1875527107402752:0@lo:104: 00000100:00100000:0.0:1788642260.318825:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:3317:x1875527107403136:12345-0@lo:103:ldlm_bl.0 Request processed in 923us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642260.318832:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788642260.318865:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107403008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642260.318899:0:5843:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788642260.318911:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107402880 00000100:00100000:0.0:1788642260.318915:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107402880 00000100:00100000:0.0:1788642260.318948:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788642260.318956:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb121450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:11696:x1875527107402880:12345-0@lo:104: 00010000:00010000:0.0:1788642260.318977:0:5843:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d255 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642260.319023:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788642260.319029:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb121450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+3:11696:x1875527107402880:12345-0@lo:104: Request processed in 74us (2283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642260.319035:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788642260.321882:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef153480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1875527107402880:0@lo:104: 00000100:00100000:3.0:1788642260.322670:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef151f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1875527107403264:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788642260.323532:0:7657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642260.323542:0:7657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666d255 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.323551:0:7657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0600 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642260.323556:0:7657:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666d255 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.323566:0:7657:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666d255 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788642260.323573:0:7657:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666d255 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642260.323579:0:7657:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788642260.323633:0:7657:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d255 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.323640:0:7657:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642260.323657:0:7657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d255 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.323664:0:7657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666d24e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666d255 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.323851:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642260.323853:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642260.323855:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642260.324004:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642260.324167:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086396800 00000100:00100000:3.0:1788642260.324176:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086396800 00010000:00010000:3.0:1788642260.324207:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d247 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a972a expref: 13 pid: 5854 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642260.324246:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:3.0:1788642260.324256:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddde4e65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086396800:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642260.324268:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642260.324273:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d247 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a972a expref: 13 pid: 5854 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.324284:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d247 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a972a expref: 13 pid: 5854 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.324299:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9833c00/0x4ae1ee156666d247 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a972a expref: 13 pid: 5854 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.324312:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642260.324371:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddde4e65050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9684ea0b-8125-4caf-b771-9063c6354463+12:2360:x1875527086396800:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 115us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642260.324379:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:0.0:1788642260.325143:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107403520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642260.325200:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642260.325659:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107403520 00000100:00100000:1.0:1788642260.325667:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107403520 00010000:00010000:1.0:1788642260.325708:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc9833200/0x4ae1ee156666d255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d24e expref: 17 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642260.325745:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788642260.325754:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:3318:x1875527107403520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788642260.325769:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642260.325774:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc9833200/0x4ae1ee156666d255 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666d24e expref: 17 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642260.325787:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc9833200/0x4ae1ee156666d255 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666d24e expref: 17 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642260.325804:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9833200/0x4ae1ee156666d255 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666d24e expref: 17 pid: 5853 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642260.325837:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642260.325888:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:3318:x1875527107403520:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642260.325895:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788642260.327278:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107403520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788642260.329533:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11696:1875527107403392:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788642260.329581:0:11696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642260.329759:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107403136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788642260.332652:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642260.332791:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086396928 00000100:00100000:2.0:1788642260.332801:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086396928 00010000:00010000:2.0:1788642260.332839:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddc0031000/0x4ae1ee156666d240 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9723 expref: 12 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642260.332900:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:2.0:1788642260.332910:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+12:2359:x1875527086396928:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642260.332927:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642260.332933:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddc0031000/0x4ae1ee156666d240 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9723 expref: 12 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642260.332946:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddc0031000/0x4ae1ee156666d240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9723 expref: 12 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642260.332976:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc0031000/0x4ae1ee156666d240 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9723 expref: 12 pid: 5853 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642260.332996:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642260.333005:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642260.333023:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642260.333031:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642260.333038:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642260.333044:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642260.333070:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f8e00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642260.333076:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642260.333085:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642260.333130:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642260.333142:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642260.333202:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+11:2359:x1875527086396928:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 292us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642260.333210:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 34 00010000:00010000:3.0:1788642260.333311:0:11696:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.333321:0:11696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642260.333328:0:11696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3a5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642260.638441:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642260.638491:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642260.638520:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642260.638593:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086397056 00000100:00100000:2.0:1788642260.638608:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086397056 00000100:00100000:2.0:1788642260.638702:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 250 00000100:00100000:2.0:1788642260.638714:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+11:2361:x1875527086397056:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642260.638798:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+11:2361:x1875527086397056:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 87us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642260.638806:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 250 00000100:00100000:3.0:1788642260.639045:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086397312 00000100:00100000:3.0:1788642260.639050:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086397312 00000100:00100000:3.0:1788642260.639082:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:3.0:1788642260.639087:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086397312:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642260.639126:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086397312:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 39us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642260.639131:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00080000:1.0:1788642260.639262:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788642260.642077:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086397184 00000100:00100000:0.0:1788642260.642108:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086397184 00000100:00100000:0.0:1788642260.642189:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 109 00000100:00100000:0.0:1788642260.642236:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086397184:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642260.642349:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086397184:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 118us (3826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642260.642358:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 109 00000100:00080000:2.0:1788642260.642472:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642260.643321:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642260.643358:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086397440 00000100:00100000:1.0:1788642260.643366:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086397440 00000100:00100000:1.0:1788642260.643415:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 110 00000100:00100000:1.0:1788642260.643424:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2361:x1875527086397440:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642260.643494:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2361:x1875527086397440:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 70us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642260.643501:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 110 00000100:00080000:2.0:1788642260.643707:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788642260.922285:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642261.406467:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642261.406688:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086397568 00000100:00100000:1.0:1788642261.406701:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086397568 00000100:00100000:1.0:1788642261.406765:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 251 00000100:00100000:1.0:1788642261.406775:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+11:5615:x1875527086397568:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788642261.406794:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642261.406814:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddcfb51400/0x4ae1ee156666d3ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9777 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642261.406849:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddcfb51400/0x4ae1ee156666d3ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9777 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642261.406878:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddcfb51400/0x4ae1ee156666d3ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9777 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642261.406887:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51400, rc 0) 00000100:00100000:1.0:1788642261.406975:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+12:5615:x1875527086397568:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 201us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642261.406982:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 251 00000100:00100000:0.0:1788642261.411282:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642261.412438:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086397696 00000100:00100000:2.0:1788642261.412455:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086397696 00000100:00100000:2.0:1788642261.412545:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 252 00000100:00100000:2.0:1788642261.412567:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+12:5615:x1875527086397696:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788642261.412906:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+12:5615:x1875527086397696:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 341us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642261.412915:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 252 00000100:00100000:3.0:1788642261.428010:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642261.428071:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086397824 00000100:00100000:2.0:1788642261.428083:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086397824 00000100:00100000:2.0:1788642261.428186:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 253 00000100:00100000:2.0:1788642261.428200:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+12:5615:x1875527086397824:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788642261.428595:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+12:5615:x1875527086397824:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 396us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642261.428605:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 253 00000100:00100000:3.0:1788642261.436323:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642261.436703:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086397952 00000100:00100000:1.0:1788642261.436713:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086397952 00000100:00100000:1.0:1788642261.436782:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 254 00000100:00100000:1.0:1788642261.436944:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+12:9978:x1875527086397952:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788642261.437229:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+12:9978:x1875527086397952:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 438us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642261.437238:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 254 00000100:00100000:0.0:1788642261.456576:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642261.456681:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086398080 00000100:00100000:2.0:1788642261.456693:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086398080 00000100:00100000:2.0:1788642261.456753:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 255 00000100:00100000:2.0:1788642261.456764:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+12:9978:x1875527086398080:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788642261.457046:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+12:9978:x1875527086398080:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 283us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642261.457054:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 255 00000100:00100000:3.0:1788642261.473896:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642261.474681:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086398208 00000100:00100000:1.0:1788642261.474694:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086398208 00000100:00100000:1.0:1788642261.474762:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 256 00000100:00100000:1.0:1788642261.474773:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+12:5615:x1875527086398208:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788642261.474805:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642261.474825:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666d3b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a977e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642261.474858:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666d3b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a977e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642261.474871:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666d3b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a977e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642261.474897:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51a00, rc 0) 00000100:00100000:1.0:1788642261.474968:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:5615:x1875527086398208:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 197us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642261.474975:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 256 00000100:00100000:0.0:1788642261.482289:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642261.482582:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086398336 00000100:00100000:3.0:1788642261.482595:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086398336 00000100:00100000:3.0:1788642261.482660:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 257 00000100:00100000:3.0:1788642261.482670:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:5615:x1875527086398336:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642261.483031:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:5615:x1875527086398336:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 360us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642261.483039:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 257 00000100:00100000:0.0:1788642261.488448:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642261.488838:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086398464 00000100:00100000:2.0:1788642261.488849:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086398464 00000100:00100000:2.0:1788642261.488914:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 258 00000100:00100000:2.0:1788642261.488925:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:5615:x1875527086398464:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788642261.489212:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:5615:x1875527086398464:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 288us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642261.489221:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 258 00000100:00100000:0.0:1788642261.491860:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642261.492061:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086398592 00000100:00100000:1.0:1788642261.492075:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086398592 00000100:00100000:1.0:1788642261.492185:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 259 00000100:00100000:1.0:1788642261.492198:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:9981:x1875527086398592:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788642261.492527:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:9981:x1875527086398592:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 330us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642261.492545:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 259 00000100:00100000:0.0:1788642261.510435:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642261.513845:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086398720 00000100:00100000:3.0:1788642261.513861:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086398720 00000100:00100000:2.0:1788642261.526302:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 260 00000100:00100000:2.0:1788642261.526869:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:9981:x1875527086398720:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788642261.528669:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:9981:x1875527086398720:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 2345us (18235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642261.528684:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 260 10000000:01000000:1.0:1788642261.563398:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788642261.563407:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ddcc509b000 from 7 10000000:01000000:1.0:1788642261.563412:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788642261.563464:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642261.563478:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642261.563489:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642261.563515:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107403648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788642261.563611:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642261.563679:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddef9f6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788642261.563782:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107403648 00000100:00100000:2.0:1788642261.563791:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107403648 00000100:00100000:2.0:1788642261.563846:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788642261.563857:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:5858:x1875527107403648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642261.563872:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642261.563887:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666d3c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d3ba expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642261.563911:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666d3c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d3ba expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642261.563923:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666d3c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d3ba expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642261.563933:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1c00, rc 0) 00000100:00100000:2.0:1788642261.563984:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107403648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642261.563991:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788642261.566483:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107403648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788642261.566513:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642261.566539:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642261.566637:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107403776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642261.566698:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642261.566745:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddce4470c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642261.568277:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107403776 00000100:00100000:2.0:1788642261.568290:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107403776 00000100:00100000:2.0:1788642261.568379:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788642261.568391:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107403776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788642261.568755:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107403776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642261.568763:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788642261.569345:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107403776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642261.569401:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107403904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642261.569459:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642261.569503:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddef9f6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788642261.569761:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107403904 00000100:00100000:0.0:1788642261.569768:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107403904 00000100:00100000:0.0:1788642261.569822:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788642261.569830:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107403904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788642261.570008:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107403904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642261.570022:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788642261.570260:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107403904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642261.572029:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:11709:1875527107404032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788642261.572148:0:11709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642261.572190:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddef9f6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788642261.572490:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107404032 00000100:00100000:0.0:1788642261.572498:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107404032 00000100:00100000:0.0:1788642261.572554:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788642261.572564:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:11709:x1875527107404032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642261.573036:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:11709:x1875527107404032:12345-0@lo:502:llog_process_th.0 Request processed in 471us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642261.573045:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788642261.573720:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:11709:1875527107404032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788642261.573762:0:11709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788642261.573787:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642261.573790:0:11709:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788642261.573800:0:11709:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ddcc509b000 00000020:00000080:1.0:1788642261.573803:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788642261.573906:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:11709:1875527107404160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788642261.573969:0:11709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642261.574723:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddef9f6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788642261.579787:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107404160 00000100:00100000:2.0:1788642261.579814:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107404160 00000100:00100000:2.0:1788642261.579912:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788642261.579926:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:11709:x1875527107404160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642261.580572:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:11709:x1875527107404160:12345-0@lo:502:llog_process_th.0 Request processed in 644us (6597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642261.580758:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788642261.581396:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:11709:1875527107404160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788642261.581448:0:11709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642261.581460:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642261.581463:0:11709:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788642261.581472:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788642261.581575:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788642261.581603:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788642261.581613:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642261.581639:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642261.581651:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788642261.581653:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddef9be800 from 7 10000000:01000000:1.0:1788642261.581656:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788642261.581691:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642261.581699:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642261.581708:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642261.581730:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107404288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788642261.581795:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642261.581827:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddef9f6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788642261.582643:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107404288 00000100:00100000:3.0:1788642261.582653:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107404288 00000100:00100000:3.0:1788642261.582695:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788642261.582705:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:5858:x1875527107404288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788642261.582720:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642261.582735:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d3c8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642261.582760:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d3c8 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642261.582783:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d3c8 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642261.582792:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f8e00, rc 0) 00000100:00100000:3.0:1788642261.582843:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107404288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642261.582849:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788642261.582893:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107404288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788642261.582909:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642261.582919:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642261.582977:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107404416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642261.583019:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642261.583042:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788642261.583054:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107404416 00000100:00100000:3.0:1788642261.583057:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107404416 00000100:00100000:3.0:1788642261.583074:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788642261.583080:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107404416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642261.584015:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107404416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 930us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642261.584024:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788642261.584930:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107404416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642261.584990:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107404544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642261.585049:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642261.585089:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddef9f6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788642261.585183:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107404544 00000100:00100000:2.0:1788642261.585191:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107404544 00000100:00100000:2.0:1788642261.585238:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788642261.585247:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107404544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788642261.585445:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107404544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642261.585452:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788642261.585734:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107404544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642261.587952:0:11711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef151f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:11711:1875527107404672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642261.588038:0:11711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642261.588088:0:11711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788642261.588265:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107404672 00000100:00100000:1.0:1788642261.588273:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107404672 00000100:00100000:1.0:1788642261.588328:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788642261.588337:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:11711:x1875527107404672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788642261.588804:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:11711:x1875527107404672:12345-0@lo:502:llog_process_th.0 Request processed in 466us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642261.588812:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788642261.592477:0:11711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef151f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:11711:1875527107404672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788642261.592548:0:11711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788642261.592559:0:11711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642261.592561:0:11711:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788642261.592568:0:11711:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dddef9be800 00000020:00000080:2.0:1788642261.592571:0:11711:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788642261.592683:0:11711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:11711:1875527107404800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642261.592763:0:11711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642261.592821:0:11711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0b0d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788642261.593023:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107404800 00000100:00100000:0.0:1788642261.593031:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107404800 00000100:00100000:0.0:1788642261.593088:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788642261.593118:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:11711:x1875527107404800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642261.593346:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:11711:x1875527107404800:12345-0@lo:502:llog_process_th.0 Request processed in 250us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642261.593354:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788642261.594322:0:11711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:11711:1875527107404800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788642261.594360:0:11711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642261.594368:0:11711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642261.594370:0:11711:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788642261.594375:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788642261.594761:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788642261.594794:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788642261.594805:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642261.594819:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642261.594829:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788642261.594832:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddc599b800 from 7 10000000:01000000:3.0:1788642261.594834:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788642261.594864:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642261.594872:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642261.594893:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642261.594912:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107404928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788642261.594959:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642261.594996:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788642261.595089:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107404928 00000100:00100000:0.0:1788642261.595122:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107404928 00000100:00100000:0.0:1788642261.595165:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788642261.595172:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc63e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:5858:x1875527107404928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788642261.595184:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642261.595197:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6121a00/0x4ae1ee156666d3dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666d3d6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642261.595220:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6121a00/0x4ae1ee156666d3dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666d3d6 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642261.595230:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6121a00/0x4ae1ee156666d3dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666d3d6 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642261.595246:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121a00, rc 0) 00000100:00100000:0.0:1788642261.595284:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc63e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107404928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642261.595291:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788642261.595477:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef153480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107404928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642261.595490:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642261.595499:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642261.595557:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107405056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788642261.595582:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642261.595602:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0b0d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788642261.595698:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107405056 00000100:00100000:0.0:1788642261.595703:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107405056 00000100:00100000:0.0:1788642261.595732:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788642261.595738:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107405056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642261.596014:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107405056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642261.596021:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788642261.596302:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107405056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788642261.596424:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107405184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788642261.596467:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642261.596504:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0b0d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788642261.596613:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107405184 00000100:00100000:3.0:1788642261.596618:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107405184 00000100:00100000:3.0:1788642261.596648:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788642261.596657:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107405184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642261.596878:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:5858:x1875527107405184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642261.596884:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788642261.596963:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae59d524-c809-4baa-a38f-29c60bd72e4e:5858:1875527107405184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788642261.597700:0:11713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:11713:1875527107405312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642261.597751:0:11713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642261.597864:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107405312 00000100:00100000:3.0:1788642261.597870:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107405312 00000100:00100000:3.0:1788642261.597913:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788642261.597922:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:11713:x1875527107405312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642261.598568:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:11713:x1875527107405312:12345-0@lo:502:llog_process_th.0 Request processed in 644us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642261.598577:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788642261.598958:0:11713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0b0dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642261.598980:0:11713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:11713:1875527107405312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788642261.599012:0:11713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788642261.599027:0:11713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642261.599030:0:11713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788642261.599036:0:11713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dddc599b800 00000020:00000080:2.0:1788642261.599038:0:11713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788642261.602844:0:11713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:11713:1875527107405440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642261.602935:0:11713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642261.602985:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107405440 00000100:00100000:2.0:1788642261.602992:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107405440 00000100:00100000:2.0:1788642261.603047:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788642261.603056:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:11713:x1875527107405440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642261.603296:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:11713:x1875527107405440:12345-0@lo:502:llog_process_th.0 Request processed in 240us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642261.603305:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788642261.603358:0:11713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0b0dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642261.603380:0:11713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae59d524-c809-4baa-a38f-29c60bd72e4e:11713:1875527107405440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788642261.603409:0:11713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642261.603417:0:11713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642261.603420:0:11713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788642261.603424:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788642261.603487:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788642261.603505:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788642261.603516:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642261.603544:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788642261.615443:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788642261.691001:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107405952:0@lo:400:kworker.0 00000100:00100000:0.0:1788642261.691075:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642261.691316:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107405568:0@lo:400:kworker.0 00000100:00100000:1.0:1788642261.691348:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642261.691393:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107406080:0@lo:400:kworker.0 00000100:00100000:1.0:1788642261.691419:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642261.691449:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642261.691456:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107405696:0@lo:400:kworker.0 00000100:00100000:1.0:1788642261.691478:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642261.691541:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107405952 00000100:00100000:1.0:1788642261.691549:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107405952 00000100:00100000:1.0:1788642261.691615:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107405568 00000100:00100000:1.0:1788642261.691619:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107405568 00000100:00100000:1.0:1788642261.691634:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107405696 00000100:00100000:1.0:1788642261.691637:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107405696 00000100:00100000:1.0:1788642261.691657:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788642261.691665:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107405952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642261.691719:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107405952:12345-0@lo:400:kworker.0 Request processed in 54us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642261.691727:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788642261.691745:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788642261.691763:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107405568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642261.691798:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107405568:12345-0@lo:400:kworker.0 Request processed in 47us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642261.691805:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788642261.691834:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788642261.691840:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107405696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642261.691869:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107405696:12345-0@lo:400:kworker.0 Request processed in 30us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642261.691875:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788642261.691893:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107406080 00000100:00100000:1.0:1788642261.691897:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107406080 00000100:00100000:1.0:1788642261.691926:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788642261.691933:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107406080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642261.691960:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107406080:12345-0@lo:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642261.691966:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788642261.692007:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107405696:0@lo:400:kworker.0 00000100:00100000:1.0:1788642261.692019:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107405568:0@lo:400:kworker.0 00000100:00100000:1.0:1788642261.692026:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788642261.692031:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dddeff81500, transno 4294967300 00000100:00100000:1.0:1788642261.692041:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107406080:0@lo:400:kworker.0 00000100:00100000:0.0:1788642261.693270:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107405952:0@lo:400:kworker.0 00000100:00100000:0.0:1788642261.693358:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788642261.693368:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107405824:0@lo:400:kworker.0 00000100:00100000:0.0:1788642261.693411:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788642261.694498:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788642261.694531:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642261.711578:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107405824 00000100:00100000:1.0:1788642261.711603:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107405824 00000100:00100000:1.0:1788642261.711708:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788642261.711722:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107405824:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788642261.716941:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642261.718876:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107405824:12345-0@lo:400:kworker.0 Request processed in 7145us (25451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642261.718894:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1788642261.719727:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfa8edf80 x1875527107405824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642261.719758:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107405824:0@lo:400:kworker.0 00010000:00010000:0.0:1788642261.946641:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642262.203262:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107406208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642262.203376:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642262.204361:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107406208 00000100:00100000:3.0:1788642262.204398:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107406208 00000100:00100000:3.0:1788642262.204519:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788642262.204532:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107406208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642262.204592:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642262.206684:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107406208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2134us (3287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642262.206702:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788642262.207551:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107406208:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788642262.651442:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788642262.972677:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642263.228375:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107406336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788642263.228485:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642263.228809:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107406336 00000100:00100000:1.0:1788642263.228837:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107406336 00000100:00080000:3.0:1788642263.229011:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642263.229048:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788642263.229061:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107406336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788642263.229264:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642263.229399:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107406336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 341us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642263.229408:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788642263.235047:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef151c00 x1875527107406336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642263.235087:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef151c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107406336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788642263.994242:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642265.018424:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642265.757036:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642265.757092:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642265.757177:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642265.757210:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642265.757250:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086398848 00000100:00100000:3.0:1788642265.757263:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086398848 00000100:00100000:2.0:1788642265.757275:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086398976 00000100:00100000:2.0:1788642265.757279:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086398976 00000100:00100000:2.0:1788642265.757322:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086399232 00000100:00100000:2.0:1788642265.757325:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086399232 00000100:00100000:3.0:1788642265.757329:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 276 00000100:00100000:3.0:1788642265.757341:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2362:x1875527086398848:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642265.757350:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 114 00000100:00100000:2.0:1788642265.757358:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086398976:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642265.757476:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 115 00000100:00100000:1.0:1788642265.757487:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086399232:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642265.757573:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2362:x1875527086398848:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 232us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642265.757581:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 276 00000100:00100000:3.0:1788642265.757625:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086399104 00000100:00100000:3.0:1788642265.757629:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086399104 00000100:00100000:3.0:1788642265.757667:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:3.0:1788642265.757674:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086399104:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642265.757726:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086399104:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 52us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642265.757733:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00080000:3.0:1788642265.757753:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788642265.757759:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642265.762142:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086398976:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 4738us (5079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642265.762175:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 114 00000100:00100000:1.0:1788642265.762275:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086399232:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 4787us (5179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642265.762284:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 115 00010000:00010000:3.0:1788642266.042530:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642266.812841:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107406592:0@lo:400:kworker.0 00000100:00100000:1.0:1788642266.812917:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642266.812977:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107407104:0@lo:400:kworker.0 00000100:00100000:1.0:1788642266.813002:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642266.813036:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642266.813042:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107406720:0@lo:400:kworker.0 00000100:00100000:1.0:1788642266.813064:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642266.813094:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107407104 00000100:00100000:1.0:1788642266.813122:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107407104 00000100:00100000:1.0:1788642266.813182:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788642266.813191:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107407104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642266.813240:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107407104:12345-0@lo:400:kworker.0 Request processed in 51us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642266.813247:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788642266.813306:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107407104:0@lo:400:kworker.0 00000100:00100000:0.0:1788642266.813388:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107406464:0@lo:400:kworker.0 00000100:00100000:0.0:1788642266.813424:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642266.813468:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107406976:0@lo:400:kworker.0 00000100:00100000:0.0:1788642266.813492:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642266.813509:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788642266.813514:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107406848:0@lo:400:kworker.0 00000100:00100000:0.0:1788642266.813537:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642266.813563:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107406592 00000100:00100000:0.0:1788642266.813567:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107406592 00000100:00100000:0.0:1788642266.813593:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107406720 00000100:00100000:0.0:1788642266.813596:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107406720 00000100:00100000:0.0:1788642266.813609:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107406976 00000100:00100000:0.0:1788642266.813612:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107406976 00000100:00100000:0.0:1788642266.813625:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788642266.813630:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107406592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642266.813665:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107406592:12345-0@lo:400:kworker.0 Request processed in 35us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642266.813672:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788642266.813684:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788642266.813690:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107406720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642266.813715:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107406720:12345-0@lo:400:kworker.0 Request processed in 25us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642266.813721:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788642266.813731:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788642266.813737:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107406976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642266.813781:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107406976:12345-0@lo:400:kworker.0 Request processed in 44us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642266.813787:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788642266.813815:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107406976:0@lo:400:kworker.0 00000100:00100000:0.0:1788642266.813841:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107406720:0@lo:400:kworker.0 00000100:00100000:0.0:1788642266.813849:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107406592:0@lo:400:kworker.0 00000100:00080000:3.0:1788642266.814890:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788642266.814898:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788642266.814908:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107406848 00000100:00100000:3.0:1788642266.814915:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107406848 00000100:00100000:3.0:1788642266.814978:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788642266.814987:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107406848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642266.815051:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107406848:12345-0@lo:400:kworker.0 Request processed in 66us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642266.815057:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788642266.815220:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642266.815279:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107406464 00000100:00100000:1.0:1788642266.815284:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107406464 00000100:00100000:1.0:1788642266.815317:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788642266.815323:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107406464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642266.815355:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107406464:12345-0@lo:400:kworker.0 Request processed in 33us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642266.815361:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00080000:0.0:1788642266.815462:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfad59180 x1875527107406848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642266.815475:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107406848:0@lo:400:kworker.0 00000100:00100000:0.0:1788642266.815485:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107406464:0@lo:400:kworker.0 00010000:00010000:0.0:1788642267.068995:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642267.322724:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642267.322757:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddface5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107407232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788642267.322885:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642267.323167:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107407232 00000100:00100000:0.0:1788642267.323180:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107407232 00000100:00100000:0.0:1788642267.323258:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788642267.323271:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107407232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788642267.323432:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642267.323518:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107407232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 249us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642267.323526:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788642267.323710:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddface5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107407232:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788642268.092530:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642268.349081:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788642268.349149:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107407360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788642268.349230:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642268.350254:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107407360 00000100:00100000:2.0:1788642268.350278:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107407360 00000100:00100000:2.0:1788642268.350396:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788642268.350411:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107407360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788642268.350475:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642268.350613:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107407360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 207us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642268.350623:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788642268.350754:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef153480 x1875527107407360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642268.350783:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef153480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107407360:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788642268.353735:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788642269.115017:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642270.142599:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642270.887665:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642270.887718:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642270.887751:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642270.887790:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642270.887839:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086399616 00000100:00100000:0.0:1788642270.887851:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086399616 00000100:00100000:0.0:1788642270.887943:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:0.0:1788642270.887956:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2359:x1875527086399616:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642270.888062:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2359:x1875527086399616:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 109us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642270.888071:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:0.0:1788642270.888121:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086399488 00000100:00100000:0.0:1788642270.888125:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086399488 00000100:00100000:0.0:1788642270.888168:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086399744 00000100:00100000:0.0:1788642270.888171:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086399744 00000100:00100000:0.0:1788642270.888193:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 119 00000100:00100000:0.0:1788642270.888200:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2359:x1875527086399488:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642270.888230:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2359:x1875527086399488:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 31us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642270.888237:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 119 00000100:00100000:0.0:1788642270.888248:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:0.0:1788642270.888254:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086399744:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642270.888276:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086399744:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 22us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642270.888282:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00080000:0.0:1788642270.888303:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788642270.888310:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788642270.889078:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086399360 00000100:00100000:3.0:1788642270.889088:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086399360 00000100:00100000:3.0:1788642270.889186:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 278 00000100:00100000:3.0:1788642270.889195:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086399360:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642270.889249:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086399360:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 55us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642270.889257:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 278 00010000:00010000:0.0:1788642271.162944:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642271.933706:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107407488:0@lo:400:kworker.0 00000100:00100000:3.0:1788642271.933753:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107407872:0@lo:400:kworker.0 00000100:00100000:2.0:1788642271.933845:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107407616:0@lo:400:kworker.0 00000100:00100000:0.0:1788642271.934167:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107407744:0@lo:400:kworker.0 00000100:00100000:1.0:1788642271.936402:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642271.936530:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107408000:0@lo:400:kworker.0 00000100:00100000:1.0:1788642271.936587:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642271.936645:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107408000 00000100:00100000:1.0:1788642271.936656:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107408000 00000100:00100000:1.0:1788642271.936739:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788642271.936784:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107408000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642271.936845:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107408000:12345-0@lo:400:kworker.0 Request processed in 63us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642271.936850:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788642271.936870:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642271.936904:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107408000:0@lo:400:kworker.0 00000100:00100000:3.0:1788642271.936932:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642271.936948:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107407488 00000100:00100000:1.0:1788642271.936952:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107407488 00000100:00100000:1.0:1788642271.936976:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788642271.937005:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107407872 00000100:00100000:3.0:1788642271.937010:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107407872 00000100:00100000:1.0:1788642271.937057:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107407488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642271.937061:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788642271.937074:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107407872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642271.937133:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107407488:12345-0@lo:400:kworker.0 Request processed in 79us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642271.937141:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788642271.937148:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107407872:12345-0@lo:400:kworker.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642271.937156:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788642271.937185:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107407488:0@lo:400:kworker.0 00000100:00100000:2.0:1788642271.937317:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642271.937362:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107408128:0@lo:400:kworker.0 00000100:00100000:2.0:1788642271.937392:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642271.937428:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107407616 00000100:00100000:2.0:1788642271.937439:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107407616 00000100:00100000:2.0:1788642271.937468:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788642271.937475:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107407616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642271.937513:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107407616:12345-0@lo:400:kworker.0 Request processed in 39us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642271.937519:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788642271.937537:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107408128 00000100:00100000:2.0:1788642271.937540:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107408128 00000100:00100000:2.0:1788642271.937565:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788642271.937571:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107408128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642271.937600:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107408128:12345-0@lo:400:kworker.0 Request processed in 29us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642271.937605:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788642271.937636:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107407616:0@lo:400:kworker.0 00000100:00100000:2.0:1788642271.937645:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107408128:0@lo:400:kworker.0 00000100:00100000:0.0:1788642271.940900:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788642271.941091:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfb4b7b80 x1875527107407872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642271.941129:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107407872:0@lo:400:kworker.0 00000100:00100000:1.0:1788642271.943574:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107407744 00000100:00100000:1.0:1788642271.943599:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107407744 00000100:00100000:1.0:1788642271.943722:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788642271.943736:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107407744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642271.943874:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107407744:12345-0@lo:400:kworker.0 Request processed in 141us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642271.943883:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788642271.943929:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107407744:0@lo:400:kworker.0 00000100:00080000:3.0:1788642271.946024:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788642271.946038:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788642271.946042:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788642272.188128:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642272.445145:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107408256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642272.445274:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642272.445834:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107408256 00000100:00100000:0.0:1788642272.445847:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107408256 00000100:00100000:0.0:1788642272.445927:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788642272.445938:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107408256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788642272.445989:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642272.446068:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107408256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642272.446076:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788642272.446407:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107408256:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788642272.890879:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788642273.210345:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642273.470856:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107408384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642273.470972:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642273.473703:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107408384 00000100:00100000:2.0:1788642273.473729:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107408384 00000100:00080000:3.0:1788642273.473835:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788642273.473868:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788642273.473881:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107408384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788642273.473938:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642273.474072:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107408384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (3100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642273.474081:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788642273.474167:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef150a80 x1875527107408384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642273.474208:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef150a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107408384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788642274.234346:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642275.262787:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642275.996309:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642275.996385:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642275.996555:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086400000 00000100:00100000:2.0:1788642275.996588:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086400000 00000100:00100000:2.0:1788642275.996684:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 124 00000100:00100000:2.0:1788642275.996696:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086400000:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642275.996798:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086400000:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 105us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642275.996807:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 124 00000100:00080000:3.0:1788642275.996890:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642275.997639:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086399872 00000100:00100000:1.0:1788642275.997649:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086399872 00000100:00100000:1.0:1788642275.997699:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 280 00000100:00100000:1.0:1788642275.997708:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086399872:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642275.997773:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086399872:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 66us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642275.997781:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 280 00000100:00100000:0.0:1788642276.016216:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642276.016267:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642276.016500:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086400128 00000100:00100000:3.0:1788642276.016511:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086400128 00000100:00100000:3.0:1788642276.016606:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:3.0:1788642276.016624:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2358:x1875527086400128:12345-192.168.202.49@tcp:9:kworker.0 00000020:00000080:3.0:1788642276.016662:0:6711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d319 00000100:00080000:3.0:1788642276.016671:0:6711:0:(import.c:65:import_set_state_nolock()) ffff8ddcc58d1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788642276.016713:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788642276.017271:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+2:2358:x1875527086400128:12345-192.168.202.49@tcp:9:kworker.0 Request processed in 652us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642276.017299:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00010000:00010000:3.0:1788642276.017325:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642276.019603:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086400256 00000100:00100000:1.0:1788642276.019647:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086400256 00000100:00100000:1.0:1788642276.019757:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 125 00000100:00100000:1.0:1788642276.019771:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086400256:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642276.019893:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086400256:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 125us (3624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642276.019900:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 125 00000100:00080000:0.0:1788642276.022399:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788642276.022415:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788642276.282479:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642277.051049:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107408640:0@lo:400:kworker.0 00000100:00100000:2.0:1788642277.051278:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642277.051359:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107409152:0@lo:400:kworker.0 00000100:00100000:2.0:1788642277.051391:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642277.051434:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788642277.051440:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107408768:0@lo:400:kworker.0 00000100:00100000:2.0:1788642277.051463:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642277.051500:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107409152 00000100:00100000:2.0:1788642277.051511:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107409152 00000100:00100000:2.0:1788642277.051585:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788642277.051596:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107409152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642277.051658:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107409152:12345-0@lo:400:kworker.0 Request processed in 64us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642277.051666:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788642277.051725:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107409152:0@lo:400:kworker.0 00000100:00100000:3.0:1788642277.052003:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107408896:0@lo:400:kworker.0 00000100:00100000:3.0:1788642277.052040:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642277.052065:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788642277.052072:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107408512:0@lo:400:kworker.0 00000100:00100000:0.0:1788642277.052238:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107408640 00000100:00100000:0.0:1788642277.052244:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107408640 00000100:00100000:0.0:1788642277.052276:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107408768 00000100:00100000:0.0:1788642277.052279:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107408768 00000100:00100000:0.0:1788642277.052303:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788642277.052310:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107408640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642277.052377:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107408640:12345-0@lo:400:kworker.0 Request processed in 67us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642277.052385:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788642277.052400:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788642277.052406:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107408768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642277.052437:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107408768:12345-0@lo:400:kworker.0 Request processed in 32us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642277.052442:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1788642277.052468:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788642277.052474:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788642277.052494:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107408768:0@lo:400:kworker.0 00000100:00100000:0.0:1788642277.052506:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107408640:0@lo:400:kworker.0 00000100:00100000:0.0:1788642277.052567:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107408896 00000100:00100000:0.0:1788642277.052571:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107408896 00000100:00100000:0.0:1788642277.052604:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788642277.052610:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107408896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642277.052642:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107408896:12345-0@lo:400:kworker.0 Request processed in 32us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642277.052648:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788642277.052662:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642277.052822:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642277.052869:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107409024:0@lo:400:kworker.0 00000100:00100000:3.0:1788642277.052898:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788642277.052927:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddf5295c00 x1875527107408896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642277.052940:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107408896:0@lo:400:kworker.0 00000100:00100000:3.0:1788642277.052962:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107409024 00000100:00100000:3.0:1788642277.052966:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107409024 00000100:00100000:3.0:1788642277.052999:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788642277.053007:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107409024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642277.053042:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107409024:12345-0@lo:400:kworker.0 Request processed in 36us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642277.053049:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1788642277.053066:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642277.053122:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107409024:0@lo:400:kworker.0 00000100:00100000:0.0:1788642277.056354:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107408512 00000100:00100000:0.0:1788642277.056374:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107408512 00000100:00100000:0.0:1788642277.056486:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788642277.056502:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107408512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642277.056639:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107408512:12345-0@lo:400:kworker.0 Request processed in 142us (4512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642277.056667:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788642277.057727:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107408512:0@lo:400:kworker.0 00010000:00010000:3.0:1788642277.306440:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642277.562367:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107409280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788642277.562485:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642277.565313:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107409280 00000100:00100000:0.0:1788642277.565346:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107409280 00000100:00100000:0.0:1788642277.565506:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788642277.565521:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107409280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788642277.570808:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642277.571002:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107409280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5477us (8508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642277.571018:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788642277.571247:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107409280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788642278.341254:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642278.586534:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107409408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642278.586661:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642278.586905:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107409408 00000100:00100000:2.0:1788642278.586919:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107409408 00000100:00100000:2.0:1788642278.587011:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788642278.587024:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107409408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788642278.587089:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642278.587201:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107409408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642278.587210:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788642278.587362:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddef152d80 x1875527107409408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642278.587390:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107409408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788642279.355020:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788642279.668360:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000020:00000080:2.0:1788642279.668375:0:7669:0:(genops.c:885:class_export_put()) final put ffff8ddcc58d7000/e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000020:00000080:1.0:1788642279.668706:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc58d7000/e32b659c-dd8d-40c5-94b4-b9b0e719a356 for lustre-OST0001 00000020:00000080:1.0:1788642279.668775:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ddcc58d1000 for lustre-OST0001 00010000:00010000:3.0:1788642280.378749:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642281.112382:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642281.112421:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642281.112447:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642281.112474:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086400512 00000100:00100000:3.0:1788642281.112484:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086400512 00000100:00100000:3.0:1788642281.112536:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086400640 00000100:00100000:3.0:1788642281.112539:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086400640 00000100:00100000:3.0:1788642281.112562:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 129 00000100:00100000:3.0:1788642281.112571:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086400512:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642281.112664:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef152d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086400512:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 93us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642281.112672:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 129 00000100:00100000:3.0:1788642281.112690:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 130 00000100:00100000:3.0:1788642281.112697:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086400640:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642281.112719:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef153480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2362:x1875527086400640:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642281.112726:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 130 00000100:00100000:3.0:1788642281.112742:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086400384 00000100:00100000:3.0:1788642281.112745:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086400384 00000100:00100000:3.0:1788642281.112767:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 282 00000100:00100000:3.0:1788642281.112772:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2362:x1875527086400384:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642281.112793:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2362:x1875527086400384:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 21us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642281.112799:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 282 00000100:00080000:3.0:1788642281.112825:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788642281.406499:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788642282.107370:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788642282.186052:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107409536:0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.186157:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642282.186242:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107409536 00000100:00100000:3.0:1788642282.186250:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107409536 00000100:00100000:3.0:1788642282.186303:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788642282.186313:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107409536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.186370:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107409536:12345-0@lo:400:kworker.0 Request processed in 58us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642282.186377:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788642282.186435:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107409536:0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.186494:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107409664:0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.186525:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642282.186560:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107409664 00000100:00100000:3.0:1788642282.186564:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107409664 00000100:00100000:3.0:1788642282.186594:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788642282.186600:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107409664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.186639:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107409664:12345-0@lo:400:kworker.0 Request processed in 39us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642282.186644:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788642282.186675:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107409664:0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.186708:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107409792:0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.186736:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642282.186770:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107409792 00000100:00100000:3.0:1788642282.186773:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107409792 00000100:00100000:3.0:1788642282.186826:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788642282.186832:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107409792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.186866:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107409792:12345-0@lo:400:kworker.0 Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642282.186872:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1788642282.186887:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642282.186908:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107409792:0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.186942:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107409920:0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.186971:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642282.187008:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107409920 00000100:00100000:3.0:1788642282.187011:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107409920 00000100:00100000:3.0:1788642282.187045:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788642282.187052:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107409920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.187086:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107409920:12345-0@lo:400:kworker.0 Request processed in 35us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642282.187093:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788642282.187130:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788642282.187151:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfaf81500 x1875527107409920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642282.187163:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107409920:0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.187191:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107410048:0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.187212:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642282.187231:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107410048 00000100:00100000:3.0:1788642282.187235:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107410048 00000100:00100000:3.0:1788642282.187254:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788642282.187259:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107410048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.187293:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107410048:12345-0@lo:400:kworker.0 Request processed in 34us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642282.187299:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1788642282.187311:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642282.187325:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107410048:0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.187351:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107410176:0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.187370:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642282.187395:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107410176 00000100:00100000:3.0:1788642282.187399:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107410176 00000100:00100000:3.0:1788642282.187428:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788642282.187434:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107410176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642282.187478:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107410176:12345-0@lo:400:kworker.0 Request processed in 44us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642282.187484:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788642282.187495:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788642282.187510:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107410176:0@lo:400:kworker.0 00010000:00010000:0.0:1788642282.426242:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642282.685453:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107410304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788642282.685532:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642282.691908:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107410304 00000100:00100000:1.0:1788642282.691930:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107410304 00000100:00100000:1.0:1788642282.692027:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788642282.692040:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107410304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642282.692084:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642282.692187:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107410304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (6654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642282.692195:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788642282.694089:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107410304:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788642283.450424:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642283.706771:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107410432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642283.706885:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642283.707048:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107410432 00000100:00100000:3.0:1788642283.707060:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107410432 00000100:00100000:3.0:1788642283.707151:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788642283.707162:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107410432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642283.707211:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642283.707271:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107410432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642283.707291:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788642283.707383:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfaf81500 x1875527107410432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642283.707405:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107410432:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788642284.446006:0:11878:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 17:04:43 (1788642283) 00010000:00010000:1.0:1788642284.474498:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642285.498631:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642285.536748:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642285.536991:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086400768 00000100:00100000:3.0:1788642285.537012:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086400768 00000100:00100000:3.0:1788642285.537151:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:3.0:1788642285.537166:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:10250:x1875527086400768:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788642285.537204:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642285.537236:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d3e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9785 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642285.537326:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d3eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642285.537344:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642285.537362:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642285.537407:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788642285.537411:0:9441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642285.537459:0:9441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d3eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642285.537488:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d3e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9785 expref: 7 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642285.537513:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d3eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9785 expref: 6 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642285.537523:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642285.537526:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788642285.537530:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833200, rc 0) 00000100:00080000:0.0:1788642285.537768:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642285.537936:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:10250:x1875527086400768:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 774us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642285.537945:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:3.0:1788642285.558026:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642285.558250:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086400896 00000100:00100000:0.0:1788642285.558265:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086400896 00000100:00100000:0.0:1788642285.558340:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:0.0:1788642285.558352:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:10251:x1875527086400896:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788642285.558380:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642285.558410:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d3f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a978c expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.558508:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d3f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.558530:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.558546:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.558565:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d400 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.558572:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.558578:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.558934:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d407 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.558957:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d407 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.558965:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d407 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642285.559016:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788642285.559021:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788642285.559048:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d407 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559059:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d3f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559067:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d3f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559074:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559081:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642285.559085:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d3f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559092:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d3f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559161:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:0.0:1788642285.559164:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642285.559170:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d3f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559187:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d3f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559220:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d400 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559226:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d400 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559232:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559237:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642285.559241:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d400 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559248:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d400 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559256:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ddde00fb900) 00010000:00010000:0.0:1788642285.559259:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642285.559261:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d400 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559267:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d400 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559307:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d3f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a978c expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559323:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d407 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a978c expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642285.559336:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ddde00fbe00) 00010000:00010000:0.0:1788642285.559339:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788642285.559342:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6120200, rc 0) 00000100:00100000:0.0:1788642285.559418:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:10251:x1875527086400896:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 1067us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642285.559427:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:2.0:1788642285.566665:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642285.566846:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086401152 00000100:00100000:1.0:1788642285.566860:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086401152 00000100:00100000:1.0:1788642285.566932:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:1.0:1788642285.566944:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:10251:x1875527086401152:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788642285.566972:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642285.567009:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d40e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9793 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.567152:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d415 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.567171:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d415 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.567186:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d415 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.569806:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d41c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.569830:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d41c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.569845:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d41c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.570254:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50200/0x4ae1ee156666d423 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.570265:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50200/0x4ae1ee156666d423 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.570284:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50200/0x4ae1ee156666d423 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642285.570297:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788642285.571271:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d415 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571283:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d415 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571291:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d415 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571297:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50c00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642285.571303:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d415 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571322:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d415 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571337:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ddde00fbe00) 00010000:00010000:1.0:1788642285.571340:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642285.571346:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d415 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571553:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d415 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571570:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d41c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571575:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d41c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571593:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d41c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571599:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642285.571602:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d41c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571608:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d41c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571619:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8dddc365f200) 00010000:00010000:1.0:1788642285.571622:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642285.571625:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d41c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.571630:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d41c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.576185:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d40e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9793 expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.576437:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50200/0x4ae1ee156666d423 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9793 expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642285.576448:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365f900) 00010000:00010000:1.0:1788642285.576452:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642285.576455:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50200, rc 0) 00000100:00100000:1.0:1788642285.576552:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:10251:x1875527086401152:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 9609us (9900us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788642285.576581:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:1.0:1788642285.591293:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642285.591866:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086401280 00000100:00100000:0.0:1788642285.591879:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086401280 00000100:00100000:0.0:1788642285.591955:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:0.0:1788642285.591964:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:10251:x1875527086401280:12345-192.168.202.49@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788642285.592126:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:10251:x1875527086401280:12345-192.168.202.49@tcp:59:lhsmtool_posix.0 Request processed in 162us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642285.592134:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 35 00000040:00080000:1.0:1788642286.208346:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788642286.234243:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642286.234343:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642286.234416:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086401408 00000100:00100000:1.0:1788642286.234427:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086401408 00000100:00100000:1.0:1788642286.234521:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 284 00000100:00100000:1.0:1788642286.234545:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2361:x1875527086401408:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642286.234631:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2361:x1875527086401408:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 89us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642286.234639:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 284 00000100:00100000:0.0:1788642286.234854:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086401536 00000100:00100000:0.0:1788642286.234860:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086401536 00000100:00100000:0.0:1788642286.234920:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 134 00000100:00100000:0.0:1788642286.234929:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2361:x1875527086401536:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642286.234976:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2361:x1875527086401536:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 49us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642286.234983:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 134 00000100:00080000:2.0:1788642286.235314:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788642286.522321:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642287.293343:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107410944:0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.293421:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642287.293525:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788642287.293533:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107410560:0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.293575:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642287.293600:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107411072:0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.293623:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642287.293651:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107410688:0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.293673:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642287.293691:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107411200:0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.293711:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642287.296285:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642287.296320:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107410816:0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.296449:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642287.296518:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107411072 00000100:00100000:0.0:1788642287.296527:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107411072 00000100:00080000:2.0:1788642287.296571:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642287.296599:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107410688 00000100:00100000:0.0:1788642287.296603:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107410688 00000100:00100000:0.0:1788642287.296621:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107410816 00000100:00100000:0.0:1788642287.296624:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107410816 00000100:00080000:2.0:1788642287.296660:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642287.296673:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788642287.296683:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107411072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.296754:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107411072:12345-0@lo:400:kworker.0 Request processed in 73us (3128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642287.296761:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788642287.296775:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788642287.296780:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107410688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.296810:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107410688:12345-0@lo:400:kworker.0 Request processed in 30us (3136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642287.296816:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788642287.296835:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788642287.296840:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107410816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.296869:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107410816:12345-0@lo:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642287.296875:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788642287.296935:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107411072:0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.296970:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107410816:0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.296980:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107410688:0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.299346:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107410560 00000100:00100000:0.0:1788642287.299367:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107410560 00000100:00100000:0.0:1788642287.299447:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788642287.299460:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107410560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642287.299569:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107410560:12345-0@lo:400:kworker.0 Request processed in 112us (5991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642287.299577:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788642287.299642:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107410560:0@lo:400:kworker.0 00000100:00100000:3.0:1788642287.300039:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107410944 00000100:00100000:3.0:1788642287.300045:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107410944 00000100:00100000:3.0:1788642287.300068:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107411200 00000100:00100000:3.0:1788642287.300072:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107411200 00000100:00100000:3.0:1788642287.300184:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788642287.300194:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107411200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642287.300253:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107411200:12345-0@lo:400:kworker.0 Request processed in 62us (6540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642287.300261:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788642287.300302:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107411200:0@lo:400:kworker.0 00000100:00100000:3.0:1788642287.300355:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788642287.300364:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107410944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642287.300406:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5295c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107410944:12345-0@lo:400:kworker.0 Request processed in 44us (6985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642287.300413:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1788642287.300446:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddf5297b80 x1875527107410944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788642303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642287.300460:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107410944:0@lo:400:kworker.0 00000100:00080000:0.0:1788642287.300871:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788642287.300877:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788642287.546688:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642287.813462:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107411328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788642287.813537:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642287.814559:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107411328 00000100:00100000:3.0:1788642287.814573:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107411328 00000100:00100000:3.0:1788642287.814644:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788642287.814664:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107411328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642287.814701:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642287.814769:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107411328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642287.814778:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788642287.814928:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107411328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642287.845517:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642287.846894:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086401664 00000100:00100000:3.0:1788642287.846906:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086401664 00000100:00100000:3.0:1788642287.846975:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:3.0:1788642287.846985:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:10293:x1875527086401664:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642287.847005:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642287.847026:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d431 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a979a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847122:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d438 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847137:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d438 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847149:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d438 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847163:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d43f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847171:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d43f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847177:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d43f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847391:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d438 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847399:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d438 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847404:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d438 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847410:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833c00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642287.847414:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d438 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847421:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d438 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847433:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642287.847437:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642287.847442:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d438 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847448:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d438 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847459:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d43f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847465:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d43f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847470:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d43f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847481:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9832a00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642287.847484:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d43f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847489:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d43f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847497:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ddde02b5400) 00010000:00010000:3.0:1788642287.847499:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642287.847502:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d43f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847507:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d43f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847543:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d431 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a979a expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847555:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642287.847557:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642287.847562:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d431 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a979a expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.847572:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833400, rc 0) 00000100:00100000:3.0:1788642287.847645:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:10293:x1875527086401664:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 662us (2144us total) trans 0 rc 301/301 00000100:00100000:3.0:1788642287.847653:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00080000:3.0:1788642287.847677:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642287.853188:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642287.853428:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086401920 00000100:00100000:0.0:1788642287.853439:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086401920 00000100:00100000:0.0:1788642287.853534:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:0.0:1788642287.853545:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:10293:x1875527086401920:12345-192.168.202.49@tcp:36:lfs.0 00010000:00010000:0.0:1788642287.853609:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642287.853636:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d3eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9785 expref: 9 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.853667:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:0.0:1788642287.853679:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642287.854126:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d446 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.854141:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d446 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.854151:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d446 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.854164:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d44d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.854171:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d44d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.854177:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d44d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642287.858549:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788642287.858571:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d446 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.858582:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d446 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.858590:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d446 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.858605:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642287.858610:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d446 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.858617:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d446 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.858634:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:0.0:1788642287.858638:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642287.858642:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d446 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.858649:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d446 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788642287.858690:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000302ceecc reply state 00000000d8396a31 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d44d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642287.858699:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788642287.858850:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:10293:x1875527086401920:12345-192.168.202.49@tcp:36:lfs.0 Request processed in 5302us (5667us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788642287.858859:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 37 00010000:00010000:3.0:1788642287.867311:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d44d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.867330:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d44d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.867338:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d44d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.867344:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642287.867350:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d44d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.867358:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d44d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.867377:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ddde00fb100) 00010000:00010000:3.0:1788642287.867380:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642287.867386:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d44d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.867393:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d44d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642287.929647:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642287.929811:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086402048 00000100:00100000:0.0:1788642287.929821:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086402048 00000100:00100000:0.0:1788642287.929891:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:0.0:1788642287.929902:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:10301:x1875527086402048:12345-192.168.202.49@tcp:101:lctl.0 00010000:00010000:0.0:1788642287.929929:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642287.929953:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d454 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97a1 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.930043:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d45b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.930058:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d45b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.930070:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d45b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642287.930148:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788642287.930152:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788642287.930194:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d45b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.930219:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d454 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97a1 expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.930236:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d45b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97a1 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642287.930245:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:0.0:1788642287.930248:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788642287.930253:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121e00, rc 0) 00000100:00100000:0.0:1788642287.930314:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:10301:x1875527086402048:12345-192.168.202.49@tcp:101:lctl.0 Request processed in 413us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642287.930321:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:0.0:1788642287.981150:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642287.986529:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086402176 00000100:00100000:3.0:1788642287.986545:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086402176 00000100:00100000:3.0:1788642287.986611:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:3.0:1788642287.986620:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:10307:x1875527086402176:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788642287.986641:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642287.986661:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d462 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97a8 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.990618:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d469 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.990642:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d469 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.990655:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d469 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.990671:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d470 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.990679:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.990686:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994181:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d477 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994201:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994213:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642287.994247:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788642287.994250:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642287.994291:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994323:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d469 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994329:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d469 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994336:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d469 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994341:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0030c00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642287.994346:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d469 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994355:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d469 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994368:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:3.0:1788642287.994371:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642287.994376:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d469 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994382:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d469 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994397:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994404:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d470 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994409:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d470 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994419:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642287.994423:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d470 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994429:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d470 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994436:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ddde02b5400) 00010000:00010000:3.0:1788642287.994439:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642287.994441:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d470 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994447:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d470 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994488:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97a8 expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994503:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97a8 expref: 11 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642287.994510:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:3.0:1788642287.994512:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788642287.994514:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031e00, rc 0) 00000100:00100000:3.0:1788642287.994593:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+11:10307:x1875527086402176:12345-192.168.202.49@tcp:101:bash.0 Request processed in 7973us (13453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642287.994602:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:1.0:1788642288.002532:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642288.002830:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086402432 00000100:00100000:3.0:1788642288.002848:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086402432 00000100:00100000:3.0:1788642288.003971:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:3.0:1788642288.003987:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+11:10307:x1875527086402432:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788642288.004009:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642288.004032:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d47e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97af expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.004192:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d485 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.004207:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d485 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.004219:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d485 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.004258:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d48c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.004266:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d48c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.004272:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d48c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788642288.005314:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788642288.005542:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.005553:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.005573:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.005610:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d485 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.005617:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d485 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.005623:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d485 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.005629:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642288.005634:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d485 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.005641:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d485 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.005653:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:3.0:1788642288.005656:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642288.005662:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d485 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.005668:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d485 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788642288.005682:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3696569 reply state 000000006566cec6 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d48c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642288.005690:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788642288.005732:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d47e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97af expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.005747:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97af expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.013021:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:3.0:1788642288.013026:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642288.013030:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833400, rc 0) 00000100:00100000:3.0:1788642288.013159:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:10307:x1875527086402432:12345-192.168.202.49@tcp:101:bash.0 Request processed in 9171us (10631us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788642288.013171:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 40 00010000:00010000:2.0:1788642288.017161:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d48c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.017181:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d48c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.017189:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d48c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.017195:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642288.017200:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d48c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.017209:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d48c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.017251:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ddde02b5900) 00010000:00010000:2.0:1788642288.017254:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642288.017260:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d48c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.017266:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d48c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642288.019815:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642288.020326:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086402560 00000100:00100000:3.0:1788642288.020347:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086402560 00000100:00100000:3.0:1788642288.020501:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:3.0:1788642288.020516:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875527086402560:12345-192.168.202.49@tcp:8:bash.0 00010000:00080000:3.0:1788642288.020562:0:6712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp t0 exp 0000000000000000 cur 375 last 0 00000020:00000080:3.0:1788642288.020607:0:6712:0:(genops.c:1385:class_connect()) connect: client e32b659c-dd8d-40c5-94b4-b9b0e719a356, cookie 0x4ae1ee156666d4a1 00002000:00100000:3.0:1788642288.020634:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e32b659c-dd8d-40c5-94b4-b9b0e719a356/ffff8dddfaee0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788642288.020666:0:6712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788642288.021136:0:6712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788642288.021182:0:6712:0:(import.c:65:import_set_state_nolock()) ffff8dddfaee5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788642288.021737:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2358:x1875527086402560:12345-192.168.202.49@tcp:8:bash.0 Request processed in 1211us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642288.021761:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:3.0:1788642288.024537:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642288.024639:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086402688 00000100:00100000:1.0:1788642288.024663:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086402688 00000100:00100000:1.0:1788642288.024748:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:1.0:1788642288.024765:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:0:x1875527086402688:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788642288.024782:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788642288.024827:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788642288.024854:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d55d5b04/0x4ae1ee156666d4a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97b6 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788642288.024884:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788642288.024903:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1788642288.024908:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642288.024917:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d55d5b04/0x4ae1ee156666d4a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97b6 expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.024958:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d55d5b04/0x4ae1ee156666d4a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97b6 expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.024975:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51600, rc 0) 00000100:00100000:1.0:1788642288.025045:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:0:x1875527086402688:12345-192.168.202.49@tcp:101:bash.0 Request processed in 283us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642288.025051:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:3.0:1788642288.029133:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642288.030602:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086402816 00000100:00100000:1.0:1788642288.030618:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086402816 00000100:00100000:1.0:1788642288.030696:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:1.0:1788642288.030710:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:10307:x1875527086402816:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788642288.030731:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642288.030753:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97bd expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.030801:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d55d5b04/0x4ae1ee156666d4a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97b6 expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.030811:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642288.030816:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642288.030821:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.030863:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d55d5b04/0x4ae1ee156666d4a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97b6 expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.030894:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d55d5b04/0x4ae1ee156666d4a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97b6 expref: 8 pid: 6709 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642288.030910:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1875527107411456:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642288.031033:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788642288.035346:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642288.035421:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086402944 00000100:00100000:3.0:1788642288.035446:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086402944 00010000:00010000:3.0:1788642288.035502:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d55d5b04/0x4ae1ee156666d4a8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97b6 expref: 9 pid: 6709 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642288.035552:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:3.0:1788642288.035564:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2359:x1875527086402944:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642288.035604:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642288.035652:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d55d5b04/0x4ae1ee156666d4a8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97b6 expref: 9 pid: 6709 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.035670:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d55d5b04/0x4ae1ee156666d4a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97b6 expref: 9 pid: 6709 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.035706:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642288.035712:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642288.035723:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.035735:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.035784:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642288.035804:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf81500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5847:1875527107411584:192.168.202.49@tcp:105: 00000100:00100000:3.0:1788642288.035916:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc656f0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788642288.038568:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d55d5b04/0x4ae1ee156666d4a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97b6 expref: 9 pid: 6709 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642288.038601:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1875527107411456:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642288.038969:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.038990:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51200, rc 0) 00000100:00100000:1.0:1788642288.039363:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:10307:x1875527086402816:12345-192.168.202.49@tcp:101:bash.0 Request processed in 8651us (10283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642288.039378:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:2.0:1788642288.051157:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642288.051211:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf81500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5847:1875527107411584:192.168.202.49@tcp:105: 00010000:00010000:1.0:1788642288.051262:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642288.051367:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086402944:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 15803us (16033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642288.051393:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:3.0:1788642288.053844:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086403200 00000100:00100000:3.0:1788642288.053878:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086403200 00000100:00100000:3.0:1788642288.053978:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:3.0:1788642288.053994:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:10307:x1875527086403200:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:3.0:1788642288.054669:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:10307:x1875527086403200:12345-192.168.202.49@tcp:35:bash.0 Request processed in 674us (3575us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788642288.054679:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:2.0:1788642288.172503:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642288.172621:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086403456 00000100:00100000:0.0:1788642288.172648:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086403456 00000100:00100000:0.0:1788642288.172743:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:0.0:1788642288.172753:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:10317:x1875527086403456:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788642288.172783:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642288.172808:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d4b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97c4 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642288.172927:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788642288.173056:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d4b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97c4 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642288.173300:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:0.0:1788642288.173303:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788642288.173309:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d4b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97c4 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642288.173323:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121200, rc 0) 00000100:00100000:2.0:1788642288.173552:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:10317:x1875527086403456:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 798us (1060us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788642288.173559:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:2.0:1788642288.175493:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642288.175576:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086403712 00000100:00100000:3.0:1788642288.175589:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086403712 00000100:00100000:3.0:1788642288.175693:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:3.0:1788642288.175708:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:10317:x1875527086403712:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788642288.176015:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:10317:x1875527086403712:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 308us (532us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788642288.176021:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:3.0:1788642288.247384:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642288.247596:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086403840 00000100:00100000:1.0:1788642288.247614:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086403840 00000100:00100000:1.0:1788642288.247765:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:1.0:1788642288.247781:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:10323:x1875527086403840:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642288.247823:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642288.247866:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d4c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97cb expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.247978:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d4cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.248001:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d4cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.248032:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d4cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642288.248163:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788642288.248169:0:9441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642288.248199:0:9441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d4cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.248240:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d4c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97cb expref: 18 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.248268:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d4cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97cb expref: 17 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.248279:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:1.0:1788642288.248282:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788642288.248287:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51e00, rc 0) 00000100:00100000:1.0:1788642288.248379:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+17:10323:x1875527086403840:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 602us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642288.248400:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:2.0:1788642288.255959:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642288.256173:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086404096 00000100:00100000:3.0:1788642288.256188:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086404096 00000100:00100000:3.0:1788642288.256274:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:3.0:1788642288.256288:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+17:10323:x1875527086404096:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642288.256320:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642288.256350:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d4d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97d2 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.256517:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d4d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.256536:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.256578:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642288.256595:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788642288.256825:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d4d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97d2 expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.256867:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97d2 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.256880:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:3.0:1788642288.256885:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642288.256890:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833c00, rc 0) 00000100:00100000:3.0:1788642288.261450:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:10323:x1875527086404096:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 5139us (5481us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788642288.261470:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:2.0:1788642288.267876:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642288.268009:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642288.268190:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086404480 00000100:00100000:0.0:1788642288.268205:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086404480 00000100:00100000:0.0:1788642288.268310:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:0.0:1788642288.268324:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:2359:x1875527086404480:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642288.268348:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642288.268387:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d4d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97d2 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642288.269389:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:0.0:1788642288.269399:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642288.269516:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:2359:x1875527086404480:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 1191us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642288.269527:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:3.0:1788642288.270384:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086404352 00000100:00100000:3.0:1788642288.270399:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086404352 00000100:00100000:2.0:1788642288.270643:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:2.0:1788642288.270656:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:10323:x1875527086404352:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642288.270705:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642288.270740:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d4e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97d9 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.270917:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d4ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.270960:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d4ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.270978:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d4ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642288.271000:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788642288.271367:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d4e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97d9 expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.271392:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d4ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97d9 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.271403:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:2.0:1788642288.271406:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788642288.271410:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1800, rc 0) 00000100:00100000:2.0:1788642288.271498:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:10323:x1875527086404352:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 844us (3635us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788642288.271504:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:2.0:1788642288.280649:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642288.281553:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086404608 00000100:00100000:1.0:1788642288.281569:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086404608 00000100:00100000:0.0:1788642288.281824:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:0.0:1788642288.281838:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2361:x1875527086404608:12345-192.168.202.49@tcp:1:lfs.0 00010000:00010000:0.0:1788642288.281920:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642288.281953:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642288.281966:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642288.281973:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788642288.281979:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642288.282146:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642288.282165:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 7 pid: 6711 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642288.282183:0:6709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6709:1875527107411712:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642288.282338:0:6709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeddfea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642288.295168:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642288.295180:0:6709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6709:1875527107411712:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788642288.295233:0:6709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642288.295419:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086404736 00000100:00100000:1.0:1788642288.295430:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086404736 00002000:00100000:1.0:1788642288.295497:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8dddeff92a00 x1875527086404736/t0(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:489/0 lens 504/0 e 0 to 0 dl 1788642299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788642288.295508:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddeff92a00 with x1875527086404736 ext(0->12) 00010000:00010000:1.0:1788642288.295517:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 8 pid: 6711 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.295533:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 8 pid: 6711 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788642288.295541:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dddeff92a00 00000100:00100000:1.0:1788642288.295581:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788642288.295592:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086404736:12345-192.168.202.49@tcp:4:lfs.0 00000001:00100000:2.0:1788642288.354607:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000100:00100000:1.0:1788642288.355550:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2360:x1875527086404736:12345-192.168.202.49@tcp:4:lfs.0 Request processed in 59951us (60443us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788642288.355573:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00002000:00100000:1.0:1788642288.355589:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8dddeff92a00 x1875527086404736/t4294967299(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:489/0 lens 504/448 e 0 to 0 dl 1788642299 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788642288.355599:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddeff92a00 with x1875527086404736 ext(0->12) 00010000:00010000:1.0:1788642288.355610:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 9 pid: 6711 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.355643:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 9 pid: 6711 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788642288.355652:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dddeff92a00 00000100:00100000:3.0:1788642288.359213:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642288.359294:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086404864 00000100:00100000:1.0:1788642288.359306:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086404864 00010000:00010000:1.0:1788642288.359356:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 9 pid: 6711 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642288.359407:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:1.0:1788642288.359417:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2362:x1875527086404864:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642288.359434:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788642288.359454:0:5847:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788642288.359457:0:5847:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788642288 00002000:00010000:1.0:1788642288.359460:0:5847:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788642288 00002000:00010000:1.0:1788642288.359462:0:5847:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788642288 00010000:00010000:1.0:1788642288.359469:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 9 pid: 6711 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.359483:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 9 pid: 6711 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.359507:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd8cc1c0/0x4ae1ee156666d4af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97bd expref: 9 pid: 6711 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.359544:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788642288.359548:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788642288.359568:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.359580:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.359616:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642288.359673:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2362:x1875527086404864:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 258us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642288.359681:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 36 00010000:00010000:3.0:1788642288.359940:0:6709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.359951:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.360028:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.360038:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.360045:0:6709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.360052:0:6709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:3.0:1788642288.360069:0:6709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.360079:0:6709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.360091:0:6709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.360142:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f5a596f/0x4ae1ee156666d4fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642288.360213:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2361:x1875527086404608:12345-192.168.202.49@tcp:1:lfs.0 Request processed in 78378us (79587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642288.360232:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:3.0:1788642288.369898:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642288.370160:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086405120 00000100:00100000:1.0:1788642288.370173:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086405120 00000100:00100000:1.0:1788642288.370245:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:1.0:1788642288.370257:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:10323:x1875527086405120:12345-192.168.202.49@tcp:35:lfs.0 00000004:00010000:1.0:1788642288.370328:0:5865:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d4ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97d9 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788642288.370678:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788642288.370735:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788642288.371373:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788642288.371444:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.371462:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d493 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97af expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.371481:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.371517:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97af expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.371534:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d493 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97af expref: 24 pid: 5862 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642288.371551:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5865:1875527107411840:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642288.371678:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788642288.378837:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642288.378952:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086405248 00000100:00100000:3.0:1788642288.378963:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086405248 00010000:00010000:3.0:1788642288.379014:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d493 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97af expref: 25 pid: 5862 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642288.379096:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:3.0:1788642288.379133:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:2360:x1875527086405248:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642288.379148:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642288.379155:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d493 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97af expref: 25 pid: 5862 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.379169:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d493 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97af expref: 25 pid: 5862 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.379244:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:3.0:1788642288.379250:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.379261:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.379268:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.379289:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642288.379339:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:2360:x1875527086405248:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 207us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642288.379346:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 37 00010000:00010000:1.0:1788642288.379718:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97af expref: 24 pid: 5862 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642288.379739:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5865:1875527107411840:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642288.379762:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.379771:0:5865:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.379776:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788642288.379923:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788642288.381481:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788642288.381638:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1875527107411968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788642288.381712:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642288.381743:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642288.381863:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107411968 00000100:00100000:3.0:1788642288.381871:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107411968 00000100:00100000:3.0:1788642288.381924:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788642288.381933:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5865:x1875527107411968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788642288.382014:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5865:x1875527107411968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642288.382021:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788642288.382260:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1875527107411968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788642288.382938:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788642288.383012:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1875527107412096:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788642288.383079:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642288.384278:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788642288.393853:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107412096 00000100:00100000:3.0:1788642288.393869:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107412096 00000100:00100000:3.0:1788642288.393938:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788642288.393948:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5865:x1875527107412096:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788642288.394286:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5865:x1875527107412096:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 339us (11206us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788642288.394294:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788642288.394535:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad58a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1875527107412096:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788642288.394642:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788642288.394712:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.394724:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.394732:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.394738:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642288.394743:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.394752:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.394769:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:1.0:1788642288.394772:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788642288.394777:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.394805:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d503 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788642288.395014:0:5865:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788642288.395313:0:5865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788642288.395326:0:5865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375856227223ns, next at 376856224887ns, rc = 0 00000001:00080000:1.0:1788642288.395334:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788642288.395373:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:1.0:1788642288.395377:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788642288.395385:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d4ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97d9 expref: 28 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642288.395512:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10323:x1875527086405120:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 25257us (25627us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788642288.395522:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000020:00080000:1.0:1788642288.395526:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788642288.404778:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642288.404951:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086405376 00000100:00100000:2.0:1788642288.404961:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086405376 00000100:00100000:2.0:1788642288.405024:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:2.0:1788642288.405037:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10323:x1875527086405376:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642288.405073:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642288.405141:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d50a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97e0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.405214:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d50a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97e0 expref: 28 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.405228:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d50a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97e0 expref: 28 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.405246:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:2.0:1788642288.405249:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788642288.405252:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0a00, rc 0) 00000100:00100000:2.0:1788642288.405313:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:10323:x1875527086405376:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 280us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642288.405319:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:0.0:1788642288.414889:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642288.414998:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086405632 00000100:00100000:3.0:1788642288.415017:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086405632 00000100:00100000:1.0:1788642288.415245:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:0.0:1788642288.415350:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddddbdcc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:10323:x1875527086405632:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788642288.415675:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddddbdcc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:10323:x1875527086405632:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 416us (797us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788642288.415684:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:2.0:1788642288.490668:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642288.490822:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086405888 00000100:00100000:1.0:1788642288.490838:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086405888 00000100:00100000:1.0:1788642288.490925:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:1.0:1788642288.490938:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:10333:x1875527086405888:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642288.490979:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642288.491020:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d511 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97e7 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642288.491233:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788642288.491642:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d511 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97e7 expref: 31 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642288.491664:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:0.0:1788642288.491667:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788642288.491672:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97e7 expref: 31 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642288.491703:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51600, rc 0) 00000100:00100000:0.0:1788642288.491806:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:10333:x1875527086405888:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 870us (1154us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788642288.491815:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:1.0:1788642288.494600:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642288.494835:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086406016 00000100:00100000:3.0:1788642288.494848:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086406016 00000100:00100000:3.0:1788642288.494933:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:3.0:1788642288.494946:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:10333:x1875527086406016:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:3.0:1788642288.495084:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d51f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495155:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d51f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495176:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d51f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495213:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d526 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495222:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495230:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495366:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d52d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495376:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d52d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495383:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d52d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788642288.495445:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d52d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495462:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d51f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495469:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d51f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495477:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d51f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495482:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9832a00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642288.495487:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d51f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495502:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d51f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495516:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:3.0:1788642288.495520:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642288.495526:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d51f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495534:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d51f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495553:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495559:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d526 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495565:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495572:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642288.495575:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495582:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d526 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495590:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ddde02b5400) 00010000:00010000:3.0:1788642288.495593:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642288.495596:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d526 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495613:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d526 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495632:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d52d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495638:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d52d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495644:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d52d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495649:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833c00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642288.495652:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d52d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495657:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d52d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495666:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:3.0:1788642288.495668:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642288.495671:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d52d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.495677:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d52d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642288.495785:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:10333:x1875527086406016:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 839us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642288.495795:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:3.0:1788642288.499624:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642288.499710:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086406272 00000100:00100000:0.0:1788642288.499729:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086406272 00000100:00100000:0.0:1788642288.499825:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788642288.499893:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:10333:x1875527086406272:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:1.0:1788642288.500320:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:10333:x1875527086406272:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 483us (714us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788642288.500331:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:0.0:1788642288.544939:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642288.545159:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086406528 00000100:00100000:2.0:1788642288.545170:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086406528 00000100:00100000:2.0:1788642288.545247:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:2.0:1788642288.545259:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:10336:x1875527086406528:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642288.545289:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642288.545316:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d534 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97ee expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.545427:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d53b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.545447:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d53b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.545491:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d53b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.545520:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.545529:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.545536:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.545990:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546002:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546010:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642288.546023:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788642288.546209:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d53b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546217:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d53b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546224:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d53b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546229:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642288.546244:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d53b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546254:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d53b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546272:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:2.0:1788642288.546275:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642288.546281:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d53b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546287:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d53b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546308:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546315:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d542 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546321:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546326:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642288.546329:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546334:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d542 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546341:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dddc98d9100) 00010000:00010000:2.0:1788642288.546343:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642288.546353:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d542 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546358:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d542 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546426:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d534 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97ee expref: 34 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546441:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97ee expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.546449:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:2.0:1788642288.546451:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788642288.546454:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0e00, rc 0) 00000100:00100000:2.0:1788642288.546675:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+33:10336:x1875527086406528:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1417us (1745us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788642288.546756:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:0.0:1788642288.551872:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642288.552454:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086406656 00000100:00100000:3.0:1788642288.552467:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086406656 00000100:00100000:3.0:1788642288.552543:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:3.0:1788642288.552555:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+33:10336:x1875527086406656:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:3.0:1788642288.552912:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.552933:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.552946:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.552979:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.552988:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d557 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.552995:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.553001:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833c00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642288.553005:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.553013:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d557 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.553027:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:3.0:1788642288.553030:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788642288.553067:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d557 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.553074:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d557 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642288.553316:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+33:10336:x1875527086406656:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 761us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642288.553325:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:3.0:1788642288.567498:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642288.567624:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086406912 00000100:00100000:1.0:1788642288.567637:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086406912 00000100:00100000:1.0:1788642288.567709:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788642288.567719:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+33:10336:x1875527086406912:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:1.0:1788642288.567991:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:10336:x1875527086406912:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 273us (504us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788642288.568000:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00010000:00010000:0.0:1788642288.574959:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642288.807500:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642288.807620:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086407168 00000100:00100000:3.0:1788642288.807634:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086407168 00000100:00100000:3.0:1788642288.807728:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:3.0:1788642288.807742:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:10367:x1875527086407168:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:3.0:1788642288.807776:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642288.807809:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d55e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97f5 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.807981:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d565 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.808004:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.808023:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642288.808053:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788642288.808348:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d55e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97f5 expref: 37 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.808401:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97f5 expref: 36 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.808413:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:3.0:1788642288.808416:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642288.808421:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833400, rc 0) 00000100:00100000:3.0:1788642288.808503:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:10367:x1875527086407168:12345-192.168.202.49@tcp:101:cat.0 Request processed in 765us (1019us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788642288.808511:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:0.0:1788642288.812383:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642288.812438:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642288.812541:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086407552 00000100:00100000:3.0:1788642288.812556:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086407552 00000100:00100000:3.0:1788642288.812645:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:3.0:1788642288.812658:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:10367:x1875527086407552:12345-192.168.202.49@tcp:35:cat.0 00000100:00100000:3.0:1788642288.813063:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:10367:x1875527086407552:12345-192.168.202.49@tcp:35:cat.0 Request processed in 406us (621us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788642288.813071:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:2.0:1788642288.814061:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086407296 00000100:00100000:2.0:1788642288.814073:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086407296 00000100:00100000:2.0:1788642288.814168:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:2.0:1788642288.814179:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddde4e66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:2359:x1875527086407296:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642288.814200:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642288.814237:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d565 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97f5 expref: 37 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.814264:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:2.0:1788642288.814271:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642288.814537:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddde4e66450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:2359:x1875527086407296:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 359us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642288.814545:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:1.0:1788642288.829822:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107412224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788642288.829959:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642288.830312:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107412224 00000100:00100000:3.0:1788642288.830324:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107412224 00000100:00100000:3.0:1788642288.830398:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788642288.830412:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875527107412224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642288.830449:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642288.830519:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875527107412224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642288.830527:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788642288.831898:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107412224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642288.893044:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642288.893235:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086407808 00000100:00100000:2.0:1788642288.893252:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086407808 00000100:00100000:2.0:1788642288.893342:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:2.0:1788642288.893355:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:10373:x1875527086407808:12345-192.168.202.49@tcp:101:dd.0 00010000:00010000:2.0:1788642288.893392:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642288.893397:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788642288.893434:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d4cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97cb expref: 36 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.893691:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:2.0:1788642288.893697:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788642288.893716:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d573 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a97fc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.893864:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.893880:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d549 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97ee expref: 36 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.893889:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.893928:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97ee expref: 36 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.893971:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97ee expref: 36 pid: 5862 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642288.893987:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeffafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107412352:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788642288.895030:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc6386840 going to sleep for 11 seconds 00000100:00100000:0.0:1788642288.906542:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642288.906726:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086407936 00000100:00100000:1.0:1788642288.906739:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086407936 00010000:00010000:1.0:1788642288.906807:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d549 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97ee expref: 37 pid: 5862 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642288.906864:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:1.0:1788642288.906877:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:2359:x1875527086407936:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642288.906898:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642288.906906:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d549 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97ee expref: 37 pid: 5862 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.906950:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97ee expref: 37 pid: 5862 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.906981:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:1.0:1788642288.907001:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.907015:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.907024:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.907080:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642288.907212:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:2359:x1875527086407936:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 338us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642288.907220:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 38 00010000:00010000:2.0:1788642288.907644:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97ee expref: 36 pid: 5862 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642288.907666:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeffafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107412352:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642288.907693:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.909152:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.909173:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642288.909218:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788642288.909840:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d573 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97fc expref: 37 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.909873:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97fc expref: 36 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642288.909909:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:1.0:1788642288.909912:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788642288.909917:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1800, rc 0) 00000100:00100000:1.0:1788642288.910026:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:10373:x1875527086407808:12345-192.168.202.49@tcp:101:dd.0 Request processed in 16672us (17013us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788642288.910045:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:0.0:1788642288.916808:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642288.918897:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086408192 00000100:00100000:2.0:1788642288.918921:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086408192 00000100:00100000:2.0:1788642288.919350:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:2.0:1788642288.919365:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:10373:x1875527086408192:12345-192.168.202.49@tcp:36:dd.0 00010000:00010000:2.0:1788642288.919841:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d588 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.919868:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642288.919885:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788642288.920256:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788642288.920291:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7704dbd reply state 00000000662c76d9 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642288.920318:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788642288.920525:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+39:10373:x1875527086408192:12345-192.168.202.49@tcp:36:dd.0 Request processed in 1161us (3735us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788642288.920534:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 52 00000020:00080000:2.0:1788642288.920541:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788642288.927570:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.927596:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d588 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.927605:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.927612:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0e00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642288.927618:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.927626:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d588 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.927648:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:3.0:1788642288.927651:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642288.927670:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d588 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642288.927678:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d588 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642289.304430:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642289.304496:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086408320 00000100:00100000:3.0:1788642289.304510:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086408320 00000100:00100000:3.0:1788642289.304604:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:3.0:1788642289.304615:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+38:10387:x1875527086408320:12345-192.168.202.49@tcp:101:stat.0 00010000:00010000:3.0:1788642289.304644:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642289.304666:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d58f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9803 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.304768:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d596 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.304783:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.304834:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.304848:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d59d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.304853:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.304867:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.304970:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.304979:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97fc expref: 39 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.304988:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5a4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.305056:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97fc expref: 39 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.305087:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97fc expref: 39 pid: 5863 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642289.305160:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f98380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107412480:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642289.305294:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0a2dc00 going to sleep for 11 seconds 00000100:00080000:0.0:1788642289.306150:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642289.311190:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f98380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107412480:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788642289.311243:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642289.312779:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642289.313456:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086408576 00000100:00100000:3.0:1788642289.313475:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086408576 00000100:00100000:3.0:1788642289.313571:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:3.0:1788642289.313583:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+40:5613:x1875527086408576:12345-192.168.202.49@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788642289.317317:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+41:5613:x1875527086408576:12345-192.168.202.49@tcp:35:ldlm_bl.0 Request processed in 3717us (4531us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788642289.317338:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:0.0:1788642289.329274:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642289.329701:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086408704 00000100:00100000:2.0:1788642289.329715:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086408704 00010000:00010000:2.0:1788642289.330074:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97fc expref: 41 pid: 5863 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642289.330171:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:2.0:1788642289.330185:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+41:2360:x1875527086408704:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642289.330206:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642289.330215:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97fc expref: 41 pid: 5863 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642289.330231:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97fc expref: 41 pid: 5863 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642289.330398:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666d57a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97fc expref: 41 pid: 5863 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642289.330421:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:2.0:1788642289.330428:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642289.330439:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642289.330467:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5a4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642289.330586:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642289.330680:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+40:2360:x1875527086408704:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 498us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642289.330689:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 39 00010000:00010000:3.0:1788642289.335346:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335373:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642289.335462:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788642289.335469:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642289.335553:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335602:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335616:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d596 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335623:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d596 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335632:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d596 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335653:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9832a00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642289.335659:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d596 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335669:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d596 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335691:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:3.0:1788642289.335695:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642289.335701:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d596 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335709:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d596 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335732:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d59d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335738:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d59d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335750:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d59d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335755:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642289.335758:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d59d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.335765:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d59d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.336299:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ddde02b5400) 00010000:00010000:3.0:1788642289.336305:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642289.336309:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d59d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.336317:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d59d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.336379:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d58f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9803 expref: 40 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.336397:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9803 expref: 39 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.336406:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:3.0:1788642289.336408:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642289.336412:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833400, rc 0) 00000100:00100000:3.0:1788642289.336587:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+39:10387:x1875527086408320:12345-192.168.202.49@tcp:101:stat.0 Request processed in 31971us (32175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642289.336619:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 53 00000001:00080000:1.0:1788642289.470674:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967327 is committed 00000001:00080000:1.0:1788642289.470708:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967333 is committed 00000004:00080000:1.0:1788642289.470717:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788642289.470740:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dddfa6d56c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788642289.470745:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ddde0ac1c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dddfa6d53c0 00000020:00080000:1.0:1788642289.470748:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ddde0ac1600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ddcc700f800 00000001:00080000:1.0:1788642289.470781:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000001:00080000:1.0:1788642289.470797:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000020:00080000:2.0:1788642289.470860:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788642289.470995:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788642289.471458:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788642289.471482:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107412608:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788642289.471569:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642289.471650:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107412608 00000100:00100000:3.0:1788642289.471657:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107412608 00000100:00100000:3.0:1788642289.471719:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788642289.471727:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1875527107412608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788642289.471756:0:6712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788642289.471795:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9c83f0, atime: 0x6a9c83f0, ctime: 0x6a9c83f0, blocks: 0x1 00010000:00010000:3.0:1788642289.471804:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbb1b701/0x4ae1ee156666d5ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.471825:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=376s v=(0 0) 00010000:00010000:3.0:1788642289.471830:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642289.471837:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb1b701/0x4ae1ee156666d5ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.471855:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbb1b701/0x4ae1ee156666d5ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.471866:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbb1b701/0x4ae1ee156666d5ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.471875:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb1b701/0x4ae1ee156666d5ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.471917:0:6712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788642289.472598:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1875527107412608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 867us (1025us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788642289.472608:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788642289.472638:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788642289.472653:0:7657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642289.472662:0:7657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbb1b701/0x4ae1ee156666d5ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.472671:0:7657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833c00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:3.0:1788642289.472676:0:7657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb1b701/0x4ae1ee156666d5ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.472685:0:7657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb1b701/0x4ae1ee156666d5ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.472704:0:7657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbb1b701/0x4ae1ee156666d5ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.472711:0:7657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbb1b701/0x4ae1ee156666d5ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.472732:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642289.472734:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642289.472735:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788642289.472777:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dddc2f98380/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788642289.472792:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107412608:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788642289.473094:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642289.475726:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086408960 00000100:00100000:3.0:1788642289.475740:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086408960 00000100:00100000:3.0:1788642289.475813:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 54 00000100:00100000:3.0:1788642289.475823:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+11:10393:x1875527086408960:12345-192.168.202.49@tcp:36:truncate.0 00010000:00010000:3.0:1788642289.475892:0:9441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642289.475926:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9803 expref: 11 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.475951:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:3.0:1788642289.475957:0:9441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642289.476503:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d5b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.476519:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.476529:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788642289.476577:0:9441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788642289.476600:0:9441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052832bd7 reply state 00000000c9552aea transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642289.476608:0:9441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788642289.476810:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:10393:x1875527086408960:12345-192.168.202.49@tcp:36:truncate.0 Request processed in 985us (3717us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788642289.476818:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 54 00000020:00080000:3.0:1788642289.476823:0:9441:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788642289.488935:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d5b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.488958:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d5b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.488968:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d5b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.488974:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642289.488980:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d5b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.488989:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d5b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.489039:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:0.0:1788642289.489043:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642289.489048:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d5b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.489055:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d5b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.594942:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642289.659422:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642289.659533:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086409088 00000100:00100000:1.0:1788642289.659544:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086409088 00000100:00100000:1.0:1788642289.659614:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:1.0:1788642289.659624:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+12:10407:x1875527086409088:12345-192.168.202.49@tcp:101:stat.0 00010000:00010000:1.0:1788642289.659665:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642289.659691:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d5b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a980a expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.659787:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d5c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.659830:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d5c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.659844:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d5c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.659863:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.659870:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.659876:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660281:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660291:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660299:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642289.660337:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788642289.660342:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642289.660370:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660383:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660404:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d5c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660411:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d5c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660418:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d5c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660423:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642289.660427:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d5c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660435:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d5c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660447:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:1.0:1788642289.660449:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642289.660455:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d5c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660461:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d5c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660475:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660481:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660487:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660499:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642289.660501:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660507:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660515:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dddc365fd00) 00010000:00010000:1.0:1788642289.660518:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642289.660528:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660534:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660581:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d5b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a980a expref: 14 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660596:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a980a expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.660603:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:1.0:1788642289.660605:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642289.660607:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50800, rc 0) 00000100:00100000:1.0:1788642289.660687:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:10407:x1875527086409088:12345-192.168.202.49@tcp:101:stat.0 Request processed in 1064us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642289.660695:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:2.0:1788642289.803066:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642289.803289:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086409344 00000100:00100000:3.0:1788642289.803301:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086409344 00000100:00100000:3.0:1788642289.803363:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00100000:3.0:1788642289.803374:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:10417:x1875527086409344:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642289.803397:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642289.803421:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9811 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642289.803527:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788642289.803669:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9811 expref: 15 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.803684:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:3.0:1788642289.803688:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788642289.803694:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d5d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9811 expref: 15 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642289.803709:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833400, rc 0) 00000100:00100000:3.0:1788642289.803885:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:10417:x1875527086409344:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 512us (828us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788642289.803892:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00100000:2.0:1788642289.826383:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642289.826514:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086409600 00000100:00100000:1.0:1788642289.826555:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086409600 00000100:00100000:1.0:1788642289.826635:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:1.0:1788642289.826647:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:10417:x1875527086409600:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:1.0:1788642289.826941:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:10417:x1875527086409600:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 294us (575us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788642289.826948:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:0.0:1788642289.932253:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642289.932634:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086409856 00000100:00100000:1.0:1788642289.932656:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086409856 00000100:00100000:1.0:1788642289.932772:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:1.0:1788642289.932793:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:10423:x1875527086409856:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788642289.932822:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642289.932846:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d5e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9818 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.932965:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.932994:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a980a expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.933006:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.933048:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a980a expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.933062:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a980a expref: 16 pid: 5863 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642289.933431:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107412736:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642289.935476:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788642289.948529:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642289.948673:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107412736:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642289.948707:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642289.950152:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086409984 00000100:00100000:1.0:1788642289.950166:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086409984 00010000:00010000:1.0:1788642289.950229:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a980a expref: 17 pid: 5863 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642289.950283:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:1.0:1788642289.950293:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+17:2359:x1875527086409984:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642289.950308:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642289.950316:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a980a expref: 17 pid: 5863 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.950328:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a980a expref: 17 pid: 5863 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.950351:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d5ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a980a expref: 17 pid: 5863 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.950371:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:1.0:1788642289.950376:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.950385:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.950392:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.950571:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642289.950648:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:2359:x1875527086409984:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 356us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642289.950667:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 40 00010000:00010000:0.0:1788642289.961859:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.961878:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642289.961906:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788642289.962138:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d5e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9818 expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.962165:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9818 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.962174:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:0.0:1788642289.962177:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788642289.962181:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50400, rc 0) 00000100:00100000:0.0:1788642289.962478:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:10423:x1875527086409856:12345-192.168.202.49@tcp:101:bash.0 Request processed in 29694us (30245us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788642289.962488:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:2.0:1788642289.981325:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642289.981480:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086410240 00000100:00100000:0.0:1788642289.981490:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086410240 00000100:00100000:0.0:1788642289.981565:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:0.0:1788642289.981575:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:10423:x1875527086410240:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:0.0:1788642289.982075:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d5f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.982161:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d5f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.982176:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d5f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788642289.982241:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788642289.982268:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047760498 reply state 00000000071cfeda transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d5f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642289.982280:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788642289.982402:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:10423:x1875527086410240:12345-192.168.202.49@tcp:36:bash.0 Request processed in 827us (1090us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788642289.982410:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 58 00000020:00080000:0.0:1788642289.982415:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788642289.987359:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:2.0:1788642289.988825:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d5f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642289.988843:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d5f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642289.988851:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d5f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642289.988858:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642289.988863:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d5f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642289.988872:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d5f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642289.988911:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:2.0:1788642289.988914:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642289.988921:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d5f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642289.988929:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d5f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642289.990832:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086410368 00000100:00100000:0.0:1788642289.990851:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086410368 00000100:00100000:0.0:1788642289.990936:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:0.0:1788642289.990945:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:10423:x1875527086410368:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788642289.990968:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642289.991002:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d5ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a981f expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.991124:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d606 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.991139:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9818 expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.991169:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d606 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.991215:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9818 expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.991231:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9818 expref: 19 pid: 5863 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642289.991246:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107412864:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642289.991354:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4d66540 going to sleep for 11 seconds 00000100:00100000:2.0:1788642289.994454:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642289.994556:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086410496 00000100:00100000:1.0:1788642289.994567:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086410496 00010000:00010000:1.0:1788642289.994625:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9818 expref: 20 pid: 5863 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642289.994678:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:1.0:1788642289.994689:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:2359:x1875527086410496:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642289.994706:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642289.994714:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9818 expref: 20 pid: 5863 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.994731:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9818 expref: 20 pid: 5863 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.994755:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:1.0:1788642289.994760:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d606 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.994772:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.994781:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d606 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642289.994822:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642289.994879:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:2359:x1875527086410496:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 192us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642289.994887:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 41 00010000:00010000:0.0:1788642289.995778:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d5ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9818 expref: 19 pid: 5863 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642289.995800:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107412864:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642289.995825:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.995835:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.995841:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642289.995893:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788642289.995899:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788642289.995921:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.995970:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d5ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a981f expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.995998:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d606 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a981f expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642289.996006:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:0.0:1788642289.996009:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788642289.996012:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5d800, rc 0) 00000100:00100000:0.0:1788642289.996076:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:10423:x1875527086410368:12345-192.168.202.49@tcp:101:bash.0 Request processed in 5131us (8729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642289.996085:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:2.0:1788642289.998209:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642289.998487:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086410752 00000100:00100000:1.0:1788642289.998498:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086410752 00000100:00100000:1.0:1788642289.998557:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:1.0:1788642289.998568:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddddbdcf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:10423:x1875527086410752:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:1.0:1788642289.998974:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddddbdcf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:10423:x1875527086410752:12345-192.168.202.49@tcp:35:bash.0 Request processed in 406us (774us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788642289.998992:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:2.0:1788642290.094394:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642290.094507:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086411008 00000100:00100000:3.0:1788642290.094518:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086411008 00000100:00100000:3.0:1788642290.094599:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:3.0:1788642290.094617:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:10433:x1875527086411008:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642290.094645:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642290.094691:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d60d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9826 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642290.095284:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788642290.095436:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d60d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9826 expref: 21 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.095453:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:3.0:1788642290.095456:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788642290.095463:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d60d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9826 expref: 21 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.095481:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833400, rc 0) 00000100:00100000:3.0:1788642290.095564:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:10433:x1875527086411008:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 948us (1181us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788642290.095572:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:2.0:1788642290.100793:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642290.100902:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086411136 00000100:00100000:0.0:1788642290.100914:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086411136 00000100:00100000:0.0:1788642290.100994:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:0.0:1788642290.101009:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:10433:x1875527086411136:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:0.0:1788642290.101136:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d61b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101155:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d61b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101168:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d61b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101187:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d622 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101218:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101225:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101575:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d629 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101585:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101592:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788642290.101641:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101653:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d61b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101660:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d61b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101667:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d61b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101673:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5ca00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642290.101679:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d61b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101687:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d61b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101707:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:0.0:1788642290.101710:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642290.101715:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d61b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101721:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d61b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101734:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101740:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d622 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101745:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101748:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5ce00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642290.101751:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101756:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d622 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101762:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ddde00fb100) 00010000:00010000:0.0:1788642290.101764:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642290.101767:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d622 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101772:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d622 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101795:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d629 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101801:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d629 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101807:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101811:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642290.101813:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101818:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d629 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101824:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:0.0:1788642290.101826:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642290.101829:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d629 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.101835:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d629 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642290.101936:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:10433:x1875527086411136:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 926us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642290.101945:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:2.0:1788642290.108641:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642290.109816:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086411392 00000100:00100000:3.0:1788642290.109831:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086411392 00000100:00100000:3.0:1788642290.109902:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:3.0:1788642290.109915:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:10433:x1875527086411392:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788642290.110252:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:10433:x1875527086411392:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 339us (1620us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788642290.110262:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:2.0:1788642290.310614:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642290.311227:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086411648 00000100:00100000:0.0:1788642290.311243:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086411648 00000100:00100000:0.0:1788642290.311337:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:0.0:1788642290.311365:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:10436:x1875527086411648:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788642290.311390:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642290.311411:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d630 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a982d expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311485:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d637 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311500:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d637 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311512:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d637 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311526:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d63e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311533:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d63e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311540:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d63e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311823:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d645 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311832:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311839:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642290.311857:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788642290.311936:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d637 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311944:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d637 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311951:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d637 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311956:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5ce00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642290.311960:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d637 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311979:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d637 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.311990:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:0.0:1788642290.311993:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642290.311997:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d637 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.312004:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d637 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.312016:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d63e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.312021:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d63e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.312036:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d63e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.312041:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5ca00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642290.312044:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d63e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.312049:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d63e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.312056:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ddde00fb100) 00010000:00010000:0.0:1788642290.312058:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642290.312061:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d63e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.312077:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d63e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.312202:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d630 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a982d expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.312216:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a982d expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.312224:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:0.0:1788642290.312225:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788642290.312228:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5dc00, rc 0) 00000100:00100000:0.0:1788642290.312295:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:10436:x1875527086411648:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 932us (1701us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788642290.312312:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:2.0:1788642290.315083:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642290.316602:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086411776 00000100:00100000:3.0:1788642290.316621:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086411776 00000100:00100000:3.0:1788642290.316700:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:3.0:1788642290.316709:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:10436:x1875527086411776:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:3.0:1788642290.316816:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d653 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.316834:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.316846:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.316878:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.316885:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d653 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.316893:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.316900:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642290.316906:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.316915:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d653 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.316930:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:3.0:1788642290.316934:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788642290.316940:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d653 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.316947:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d653 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642290.317092:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:10436:x1875527086411776:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 383us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642290.317128:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:2.0:1788642290.326147:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642290.328308:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086411904 00000100:00100000:1.0:1788642290.328334:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086411904 00000100:00100000:1.0:1788642290.328457:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:1.0:1788642290.328470:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:2360:x1875527086411904:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642290.328492:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642290.328525:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d645 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a982d expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642290.328552:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:1.0:1788642290.328559:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642290.328633:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:2360:x1875527086411904:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 166us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642290.328642:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:0.0:1788642290.342904:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642290.344849:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086412160 00000100:00100000:3.0:1788642290.344880:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086412160 00000100:00100000:3.0:1788642290.345220:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:3.0:1788642290.345234:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:10436:x1875527086412160:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788642290.349201:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:10436:x1875527086412160:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 3948us (6285us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788642290.349221:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:2.0:1788642290.559896:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642290.560045:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086412416 00000100:00100000:0.0:1788642290.560072:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086412416 00000100:00100000:0.0:1788642290.560193:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:0.0:1788642290.560205:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:10455:x1875527086412416:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:0.0:1788642290.560233:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642290.560263:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d65a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9834 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.560379:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d661 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.560397:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.560411:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d661 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642290.560423:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788642290.560962:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d65a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9834 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.560989:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d661 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9834 expref: 25 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642290.560998:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:0.0:1788642290.561002:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788642290.561020:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5ca00, rc 0) 00000100:00100000:0.0:1788642290.561160:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:10455:x1875527086412416:12345-192.168.202.49@tcp:101:cat.0 Request processed in 956us (1280us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788642290.561168:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:2.0:1788642290.583290:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642290.583657:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086412544 00000100:00100000:3.0:1788642290.583671:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086412544 00000100:00100000:3.0:1788642290.583766:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:3.0:1788642290.583999:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:10456:x1875527086412544:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642290.584041:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642290.584075:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d66f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a983b expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.584251:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.584270:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.584287:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642290.584349:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788642290.584354:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642290.584379:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.584418:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d66f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a983b expref: 27 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.584443:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a983b expref: 26 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.584454:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:3.0:1788642290.584458:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788642290.584464:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833c00, rc 0) 00000100:00100000:3.0:1788642290.584702:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:10456:x1875527086412544:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 924us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642290.584711:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:2.0:1788642290.594381:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642290.594545:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086412928 00000100:00100000:1.0:1788642290.594581:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086412928 00000100:00100000:1.0:1788642290.594658:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:1.0:1788642290.594671:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddefface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:10456:x1875527086412928:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:1.0:1788642290.595070:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddefface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10456:x1875527086412928:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 400us (702us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788642290.595078:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:2.0:1788642290.606389:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642290.606921:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086413056 00000100:00100000:3.0:1788642290.606938:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086413056 00000100:00100000:3.0:1788642290.607052:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:3.0:1788642290.607065:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10456:x1875527086413056:12345-192.168.202.49@tcp:103:lfs.0 00010000:00010000:3.0:1788642290.607086:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788642290.607178:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d606 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a981f expref: 27 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.607210:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d661 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9834 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.607253:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d50a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97e0 expref: 25 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.607269:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9d00) 00010000:00010000:3.0:1788642290.607284:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642290.607369:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:10456:x1875527086413056:12345-192.168.202.49@tcp:103:lfs.0 Request processed in 307us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642290.607379:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00010000:00010000:0.0:1788642290.618964:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642290.622267:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642290.622992:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086413184 00000100:00100000:3.0:1788642290.623008:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086413184 00000100:00100000:3.0:1788642290.623090:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:3.0:1788642290.623137:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:10456:x1875527086413184:12345-192.168.202.49@tcp:58:lfs.0 00010000:00010000:3.0:1788642290.623291:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d67d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.623314:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d67d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642290.623329:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d67d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788642290.625336:0:9441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788642290.625684:0:9441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788642290.625836:0:9441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788642290.626056:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:10456:x1875527086413184:12345-192.168.202.49@tcp:58:lfs.0 Request processed in 2946us (5267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642290.626069:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:0.0:1788642290.656234:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642290.656378:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086413312 00000100:00100000:2.0:1788642290.656393:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086413312 00000100:00100000:2.0:1788642290.656474:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 67 00000100:00100000:2.0:1788642290.656487:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:10458:x1875527086413312:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642290.656517:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642290.656547:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d684 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9842 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.657061:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d68b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.657080:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d68b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.657095:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d68b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.657444:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d692 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.657453:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.657461:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658052:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658067:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658075:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642290.658154:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788642290.658159:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788642290.658185:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658213:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658224:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d68b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658231:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d68b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658238:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d68b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658245:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1e00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642290.658250:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d68b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658259:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d68b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658273:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:2.0:1788642290.658277:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642290.658282:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d68b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658289:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d68b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658304:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d692 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658311:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d692 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658323:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d692 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658328:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642290.658332:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d692 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658338:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d692 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658347:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dddc98d9800) 00010000:00010000:2.0:1788642290.658350:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642290.658364:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d692 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658372:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d692 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658433:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d684 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9842 expref: 26 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658453:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9842 expref: 25 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642290.658462:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5400) 00010000:00010000:2.0:1788642290.658464:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788642290.658467:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0a00, rc 0) 00000100:00100000:2.0:1788642290.658711:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:10458:x1875527086413312:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 2224us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642290.658733:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 67 00000040:00080000:1.0:1788642291.328435:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788642291.328446:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788642291.328510:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788642291.328520:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788642291.328695:0:11714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11714:1875527107412992:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788642291.328827:0:11714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788642291.337241:0:11714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad5ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11714:1875527107412992:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788642291.337680:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.337758:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086413440 00000100:00100000:3.0:1788642291.337817:0:5872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086413440 00000100:00100000:3.0:1788642291.337906:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:3.0:1788642291.337927:0:5872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:10469:x1875527086413440:12345-192.168.202.49@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788642291.338031:0:5872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:10469:x1875527086413440:12345-192.168.202.49@tcp:900:lhsmtool_posix.0 Request processed in 114us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642291.338041:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00080000:1.0:1788642291.338175:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642291.355989:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642291.356049:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642291.356086:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086413568 00000100:00100000:1.0:1788642291.356123:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086413568 00000100:00100000:1.0:1788642291.356197:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 286 00000100:00100000:1.0:1788642291.356209:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086413568:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642291.356317:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086413568:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 110us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642291.356326:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 286 00000100:00100000:2.0:1788642291.356560:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086413696 00000100:00100000:2.0:1788642291.356566:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086413696 00000100:00100000:2.0:1788642291.356623:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00100000:2.0:1788642291.356632:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086413696:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642291.356671:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086413696:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 41us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642291.356679:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00080000:1.0:1788642291.359159:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788642291.364012:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642291.364064:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.364151:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086413824 00000100:00100000:3.0:1788642291.364164:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086413824 00000100:00100000:3.0:1788642291.364242:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086413952 00000100:00100000:3.0:1788642291.364246:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086413952 00000100:00100000:3.0:1788642291.364272:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 138 00000100:00100000:3.0:1788642291.364284:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086413824:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642291.364381:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086413824:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 98us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642291.364389:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 138 00000100:00100000:3.0:1788642291.364409:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:3.0:1788642291.364415:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:10469:x1875527086413952:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788642291.364443:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788642291.364536:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:10469:x1875527086413952:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 120us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642291.364543:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00080000:2.0:1788642291.364777:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642291.369989:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.370089:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086414080 00000100:00100000:3.0:1788642291.370132:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086414080 00000100:00100000:3.0:1788642291.370222:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:3.0:1788642291.370235:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:10469:x1875527086414080:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788642291.370349:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d6a0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.370373:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d6a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.370389:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d6a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381021:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d6a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381056:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381072:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381143:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d6ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381153:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d6ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381160:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d6ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642291.381239:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788642291.381244:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788642291.381268:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d6ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381283:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d6a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381290:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d6a0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381299:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d6a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381304:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9832a00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642291.381309:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d6a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381318:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d6a0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381333:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365f900) 00010000:00010000:2.0:1788642291.381337:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642291.381343:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d6a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381351:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9832a00/0x4ae1ee156666d6a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381368:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d6a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381385:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d6a7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381391:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d6a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381397:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1e00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642291.381400:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d6a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381407:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d6a7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381416:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8dddc98d9800) 00010000:00010000:2.0:1788642291.381418:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642291.381421:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d6a7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381428:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d6a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381449:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d6ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381456:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d6ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381462:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d6ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381467:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642291.381476:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d6ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381484:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d6ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381493:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5400) 00010000:00010000:2.0:1788642291.381496:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642291.381499:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d6ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.381506:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d6ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642291.381641:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:10469:x1875527086414080:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 Request processed in 11401us (11660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642291.381655:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:3.0:1788642291.386571:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.386627:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086414336 00000100:00100000:3.0:1788642291.386640:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086414336 00000100:00100000:3.0:1788642291.386730:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:3.0:1788642291.386744:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:10469:x1875527086414336:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788642291.386784:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642291.386813:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d6b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9849 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.386989:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.387011:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.387028:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642291.387042:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788642291.387235:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.387246:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.387252:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.387258:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642291.387264:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.387273:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.387289:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5400) 00010000:00010000:3.0:1788642291.387293:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788642291.387300:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.387307:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.387368:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d6b5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9849 expref: 27 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.387382:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365f900) 00010000:00010000:3.0:1788642291.387384:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788642291.387389:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833200/0x4ae1ee156666d6b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9849 expref: 27 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.387412:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc9833200, rc 0) 00000100:00100000:3.0:1788642291.387510:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:10469:x1875527086414336:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 769us (962us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788642291.387519:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:2.0:1788642291.390656:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642291.390865:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086414464 00000100:00100000:1.0:1788642291.390883:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086414464 00000100:00100000:1.0:1788642291.390985:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 71 00000100:00100000:1.0:1788642291.391010:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:10469:x1875527086414464:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788642291.391066:0:9441:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788642291.391258:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:10469:x1875527086414464:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 250us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642291.391266:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 71 00000100:00100000:2.0:1788642291.401739:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642291.401800:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086414720 00000100:00100000:0.0:1788642291.401815:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086414720 00000100:00100000:0.0:1788642291.401896:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 72 00000100:00100000:0.0:1788642291.401911:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:10469:x1875527086414720:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788642291.401954:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642291.401958:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788642291.401992:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833c00/0x4ae1ee156666d676 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a983b expref: 26 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.402018:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:0.0:1788642291.402025:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642291.402042:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666d6ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9850 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788642291.403254:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788642291.403686:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666d6d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.403778:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666d6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.403795:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666d6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.403900:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666d6ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9850 expref: 28 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.403931:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666d6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9850 expref: 27 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.403942:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ddde00fb600) 00010000:00010000:0.0:1788642291.403945:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788642291.403949:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5da00, rc 0) 00000100:00100000:0.0:1788642291.404054:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10469:x1875527086414720:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 2146us (2325us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788642291.404065:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 72 00000100:00100000:1.0:1788642291.407199:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642291.407320:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086414976 00000100:00100000:0.0:1788642291.407334:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086414976 00000100:00100000:0.0:1788642291.407415:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 73 00000100:00100000:0.0:1788642291.407427:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10469:x1875527086414976:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788642291.407510:0:9441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642291.407607:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666d6d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9850 expref: 27 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.407629:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ddde00fb600) 00010000:00010000:0.0:1788642291.407644:0:9441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642291.407674:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666d6df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.407693:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666d6df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.407783:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666d6df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411041:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d6e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5e7d7da8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411080:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d6e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e7d7da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411132:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d6e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e7d7da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411489:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666d6df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411500:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666d6df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411507:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666d6df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411515:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642291.411521:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666d6df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411530:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666d6df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411561:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:1.0:1788642291.411570:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642291.411576:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666d6df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411587:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666d6df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411603:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d6e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e7d7da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411609:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d6e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e7d7da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411614:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d6e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e7d7da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411620:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642291.411622:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d6e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e7d7da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411628:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d6e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5e7d7da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411636:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5e7d7da8 (ffff8dddc365fd00) 00010000:00010000:1.0:1788642291.411639:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642291.411642:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d6e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5e7d7da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.411648:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d6e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5e7d7da8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642291.412141:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:10469:x1875527086414976:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 4675us (5057us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788642291.412152:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 73 00000100:00100000:3.0:1788642291.414800:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642291.414888:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086415104 00000100:00100000:1.0:1788642291.414900:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086415104 00000100:00100000:1.0:1788642291.414983:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 74 00000100:00100000:1.0:1788642291.414996:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:10469:x1875527086415104:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788642291.415024:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642291.415055:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d6ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9857 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.415143:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d6f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.415163:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.415178:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d6f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.415299:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d6ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9857 expref: 28 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.415319:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9857 expref: 27 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.415330:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dddc365f500) 00010000:00010000:1.0:1788642291.415340:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788642291.415344:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51e00, rc 0) 00000100:00100000:1.0:1788642291.415422:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10469:x1875527086415104:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 430us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642291.415430:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 74 00000100:00100000:0.0:1788642291.423312:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.423409:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086415360 00000100:00100000:3.0:1788642291.423423:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086415360 00000100:00100000:3.0:1788642291.423504:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 75 00000100:00100000:3.0:1788642291.423516:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10469:x1875527086415360:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788642291.423631:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.423658:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.423675:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788642291.424167:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788642291.424179:0:5862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378885080316ns, next at 379885077767ns, rc = 0 00000004:00010000:3.0:1788642291.424292:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd9b4341 reply state 00000000cc0298d3 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642291.424304:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788642291.424431:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:10469:x1875527086415360:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 915us (1131us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788642291.424441:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 75 00010000:00010000:0.0:1788642291.431643:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.431680:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.431689:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.431832:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642291.431861:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.431871:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.431900:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dddc365f500) 00010000:00010000:0.0:1788642291.431903:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788642291.431908:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.431925:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121600/0x4ae1ee156666d6fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642291.439222:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.441612:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086415488 00000100:00100000:3.0:1788642291.441628:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086415488 00000100:00100000:3.0:1788642291.441785:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00100000:3.0:1788642291.441798:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:10469:x1875527086415488:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788642291.441830:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642291.441854:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d702 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a985e expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.441935:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d702 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a985e expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.441949:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d702 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a985e expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.442150:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dddc365f500) 00010000:00010000:0.0:1788642291.442155:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788642291.442173:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121200, rc 0) 00000100:00100000:0.0:1788642291.442240:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:10469:x1875527086415488:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 443us (3027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642291.442248:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00100000:1.0:1788642291.450580:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.450708:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086415616 00000100:00100000:3.0:1788642291.450718:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086415616 00000100:00100000:3.0:1788642291.450770:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:3.0:1788642291.450778:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875527086415616:12345-192.168.202.49@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788642291.450816:0:6712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp t0 exp 0000000000000000 cur 378 last 0 00000020:00000080:3.0:1788642291.450847:0:6712:0:(genops.c:1385:class_connect()) connect: client e32b659c-dd8d-40c5-94b4-b9b0e719a356, cookie 0x4ae1ee156666d709 00002000:00100000:3.0:1788642291.450859:0:6712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e32b659c-dd8d-40c5-94b4-b9b0e719a356/ffff8dddf7f24000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788642291.450887:0:6712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788642291.451184:0:6712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788642291.451217:0:6712:0:(import.c:65:import_set_state_nolock()) ffff8dddf7f26000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788642291.451451:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2358:x1875527086415616:12345-192.168.202.49@tcp:8:lhsmtool_posix.0 Request processed in 670us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642291.451475:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:2.0:1788642291.469278:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.469431:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086415744 00000100:00100000:3.0:1788642291.469444:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086415744 00000100:00100000:3.0:1788642291.469533:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:3.0:1788642291.469544:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:0:x1875527086415744:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788642291.469902:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788642291.600806:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1788642291.600826:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000100:00100000:3.0:1788642291.601734:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:0:x1875527086415744:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 132184us (132468us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788642291.601746:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:0.0:1788642291.605564:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.606144:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086416000 00000100:00100000:3.0:1788642291.606163:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086416000 00000100:00100000:3.0:1788642291.606227:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:3.0:1788642291.606238:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:10469:x1875527086416000:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788642291.606550:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:10469:x1875527086416000:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 312us (1460us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788642291.606559:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:0.0:1788642291.615231:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.615298:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086416256 00000100:00100000:3.0:1788642291.615314:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086416256 00000100:00100000:3.0:1788642291.615398:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00100000:3.0:1788642291.615411:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:10469:x1875527086416256:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788642291.615559:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:10469:x1875527086416256:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 152us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642291.615567:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00100000:3.0:1788642291.636888:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.636938:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086416384 00000100:00100000:3.0:1788642291.636962:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086416384 00000100:00100000:3.0:1788642291.637033:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 78 00000100:00100000:3.0:1788642291.637044:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:10469:x1875527086416384:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788642291.637070:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642291.637093:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d710 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9865 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.637201:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d717 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.637216:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.637232:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642291.637273:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642291.637297:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.637326:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d710 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9865 expref: 32 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.637344:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9865 expref: 31 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.637353:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dddc365f500) 00010000:00010000:3.0:1788642291.637356:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788642291.637359:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031600, rc 0) 00000100:00100000:3.0:1788642291.637425:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:10469:x1875527086416384:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 382us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642291.637439:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 78 00000100:00100000:0.0:1788642291.647891:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.648048:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086416512 00000100:00100000:3.0:1788642291.648059:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086416512 00000100:00100000:3.0:1788642291.648134:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:3.0:1788642291.648145:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086416512:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788642291.648163:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642291.648186:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071a9675d/0x4ae1ee156666d71e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a986c expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788642291.648212:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c83f3, blocks: 0x1 00010000:00010000:3.0:1788642291.648232:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1788642291.648236:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642291.648247:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071a9675d/0x4ae1ee156666d71e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a986c expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.648279:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000071a9675d/0x4ae1ee156666d71e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a986c expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.648293:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031000, rc 0) 00000100:00100000:3.0:1788642291.648350:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086416512:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 208us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642291.648357:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 27 00010000:00010000:1.0:1788642291.652300:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642291.661272:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.662912:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086416768 00000100:00100000:3.0:1788642291.662930:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086416768 00000100:00100000:3.0:1788642291.663004:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:3.0:1788642291.663014:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:10469:x1875527086416768:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788642291.663167:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:10469:x1875527086416768:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 154us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642291.663175:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:2.0:1788642291.672186:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642291.675040:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086416896 00000100:00100000:0.0:1788642291.675057:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086416896 00000100:00100000:0.0:1788642291.675145:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:0.0:1788642291.675158:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:10469:x1875527086416896:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788642291.675179:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642291.675216:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9873 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.675258:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000071a9675d/0x4ae1ee156666d71e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a986c expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.675576:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642291.675581:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642291.675588:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9873 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.675633:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000071a9675d/0x4ae1ee156666d71e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a986c expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.675647:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000071a9675d/0x4ae1ee156666d71e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a986c expref: 7 pid: 6712 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642291.675677:0:6709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1875527107413120:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642291.675783:0:6709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642291.680484:0:6709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1875527107413120:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642291.680527:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9873 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.680578:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5de00, rc 0) 00000100:00100000:2.0:1788642291.680635:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:10469:x1875527086416896:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 5479us (8456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642291.680643:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:2.0:1788642291.683165:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642291.683332:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086417024 00000100:00100000:1.0:1788642291.683344:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086417024 00010000:00010000:1.0:1788642291.683400:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071a9675d/0x4ae1ee156666d71e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a986c expref: 7 pid: 6712 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642291.683452:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:1.0:1788642291.683464:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddde4e65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086417024:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642291.683482:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642291.683524:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000071a9675d/0x4ae1ee156666d71e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a986c expref: 7 pid: 6712 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.683540:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000071a9675d/0x4ae1ee156666d71e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a986c expref: 7 pid: 6712 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.683569:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071a9675d/0x4ae1ee156666d71e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a986c expref: 7 pid: 6712 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.683596:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642291.683601:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642291.683628:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9873 expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.683638:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9873 expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.683684:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9873 expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642291.683699:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5847:1875527107413248:192.168.202.49@tcp:105: 00000100:00100000:1.0:1788642291.683807:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642291.688761:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5847:1875527107413248:192.168.202.49@tcp:105: 00010000:00010000:0.0:1788642291.688794:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642291.688865:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddde4e65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086417024:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 5403us (5713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642291.688878:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:3.0:1788642291.709703:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642291.709779:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086417152 00000100:00100000:2.0:1788642291.709788:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086417152 00002000:00100000:2.0:1788642291.709840:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8dddc4e35c00 x1875527086417152/t0(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:492/0 lens 504/0 e 0 to 0 dl 1788642302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788642291.709851:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddc4e35c00 with x1875527086417152 ext(0->8) 00002000:00010000:2.0:1788642291.709857:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddc4e35c00 00000100:00100000:2.0:1788642291.709884:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:2.0:1788642291.709892:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086417152:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788642291.710579:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2361:x1875527086417152:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 Request processed in 683us (883us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788642291.710588:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00002000:00100000:2.0:1788642291.710598:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8dddc4e35c00 x1875527086417152/t4294967302(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:492/0 lens 504/448 e 0 to 0 dl 1788642302 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788642291.710607:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddc4e35c00 with x1875527086417152 ext(0->8) 00002000:00010000:2.0:1788642291.710612:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddc4e35c00 00000100:00100000:0.0:1788642291.722317:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.722926:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086417280 00000100:00100000:3.0:1788642291.722936:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086417280 00000100:00100000:3.0:1788642291.722996:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:3.0:1788642291.723007:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:10469:x1875527086417280:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 00000040:00080000:2.0:1788642291.787426:0:12029:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642291.787437:0:12029:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642291.787474:0:12029:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788642291.787485:0:12029:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788642291.817910:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:10469:x1875527086417280:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 Request processed in 94882us (95579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642291.817925:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 80 00000001:00080000:3.0:1788642291.817977:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000020:00080000:3.0:1788642291.818009:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1788642291.818056:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788642291.818065:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:3.0:1788642291.819318:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788642291.819329:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:1.0:1788642291.823394:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788642291.823422:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107413376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788642291.823498:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642291.826811:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107413376 00000100:00100000:3.0:1788642291.826826:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107413376 00000100:00100000:3.0:1788642291.826889:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788642291.826937:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107413376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788642291.827137:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788642291.827140:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788642291 00002000:00010000:3.0:1788642291.827143:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788642291.827146:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788642291 -> 1788642291 00002000:00010000:3.0:1788642291.827148:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788642291.827224:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1875527107413376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 290us (3724us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788642291.827245:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788642291.827348:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00080000:3.0:1788642291.827368:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788642291.827379:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086417408 00000100:00100000:3.0:1788642291.827383:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086417408 00000100:00100000:3.0:1788642291.827408:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:3.0:1788642291.827415:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2359:x1875527086417408:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1788642291.827490:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dddc5dcd180/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788642291.827498:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107413376:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1788642291.891025:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:2.0:1788642291.891046:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1788642291.892148:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086417408:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 Request processed in 64724us (64793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642291.892161:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:3.0:1788642291.920334:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.920377:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086417664 00000100:00100000:3.0:1788642291.920387:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086417664 00000100:00100000:3.0:1788642291.920439:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:3.0:1788642291.920451:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:10469:x1875527086417664:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788642291.920525:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642291.920554:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d717 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9865 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.920575:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dddc365f500) 00010000:00010000:3.0:1788642291.920580:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642291.920611:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d72c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.920646:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d72c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.920658:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d72c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788642291.920989:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000325d1563 reply state 00000000325118ff transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d72c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642291.921000:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788642291.921127:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:10469:x1875527086417664:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 677us (803us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788642291.921136:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:3.0:1788642291.927320:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.927352:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086417792 00000100:00100000:3.0:1788642291.927361:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086417792 00000100:00100000:3.0:1788642291.927405:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:3.0:1788642291.927414:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086417792:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788642291.927662:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788642291.927666:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788642291 -> 1788642290 00002000:00010000:3.0:1788642291.927668:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788642288 00002000:00010000:3.0:1788642291.927671:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788642291 -> 1788642290 00002000:00010000:3.0:1788642291.927673:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788642291.927731:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2362:x1875527086417792:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 318us (419us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788642291.927739:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 31 00010000:00010000:1.0:1788642291.928736:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d72c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.928749:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d72c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.928757:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d72c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.928763:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642291.928768:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d72c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.928786:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d72c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.928801:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dddc365f500) 00010000:00010000:1.0:1788642291.928804:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642291.928809:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d72c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.928815:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d72c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642291.933433:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642291.933796:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086418048 00000100:00100000:1.0:1788642291.933808:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086418048 00000100:00100000:1.0:1788642291.933895:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 82 00000100:00100000:1.0:1788642291.933908:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:10469:x1875527086418048:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788642291.934002:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.934022:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d6f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9857 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.934032:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.934071:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9857 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.934086:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d6f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9857 expref: 13 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642291.934152:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107413504:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642291.934262:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642291.939614:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107413504:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642291.939646:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642291.947778:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.948138:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086418176 00000100:00100000:3.0:1788642291.948149:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086418176 00010000:00010000:3.0:1788642291.948204:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d6f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9857 expref: 14 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642291.948255:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:3.0:1788642291.948267:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:2359:x1875527086418176:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642291.948286:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642291.948294:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d6f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9857 expref: 14 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.948308:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d6f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9857 expref: 14 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.948331:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d6f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9857 expref: 14 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.948347:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dddc365f500) 00010000:00010000:3.0:1788642291.948352:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.948363:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.948371:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.948399:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642291.948454:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:2359:x1875527086418176:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 188us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642291.948469:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 43 00010000:00010000:1.0:1788642291.949137:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.949148:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.949188:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.949195:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.949202:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.949209:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642291.949214:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.949222:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.949248:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dddc365f500) 00010000:00010000:1.0:1788642291.949250:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788642291.949254:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.949261:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d733 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642291.949316:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+12:10469:x1875527086418048:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 Request processed in 15409us (15891us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788642291.949324:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 82 00000100:00100000:2.0:1788642291.954867:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642291.955010:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086418304 00000100:00100000:3.0:1788642291.955026:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086418304 00000100:00100000:3.0:1788642291.955119:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:3.0:1788642291.955130:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef7d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086418304:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788642291.955176:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.955207:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9873 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.955215:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642291.955220:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788642291.955225:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.955258:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9873 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642291.955272:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9873 expref: 7 pid: 6709 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642291.955288:0:6709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1875527107413632:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642291.955392:0:6709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788642291.974206:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642291.974521:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086418432 00000100:00100000:1.0:1788642291.974539:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086418432 00010000:00010000:1.0:1788642291.974576:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9873 expref: 8 pid: 6709 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642291.974611:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:1.0:1788642291.974621:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086418432:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642291.974637:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642291.974660:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9873 expref: 8 pid: 6709 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.974675:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9873 expref: 8 pid: 6709 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.974702:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788642291.974706:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788642291.974720:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.974730:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642291.974753:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642291.974810:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086418432:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 190us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642291.974818:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 44 00010000:00010000:0.0:1788642291.976152:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666d725 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9873 expref: 7 pid: 6709 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642291.976169:0:6709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd780700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1875527107413632:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642291.976192:0:6709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.976204:0:6709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.976211:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.976240:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.976259:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.976267:0:6709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.976274:0:6709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031400 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642291.976279:0:6709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.976287:0:6709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.976303:0:6709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.976311:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d73a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642291.976381:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef7d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086418304:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 Request processed in 21253us (21528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642291.976390:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:3.0:1788642291.979132:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642291.979314:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086418688 00000100:00100000:0.0:1788642291.979324:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086418688 00000100:00100000:0.0:1788642291.979372:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 83 00000100:00100000:0.0:1788642291.979392:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+12:10469:x1875527086418688:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788642291.979634:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666d741 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.979653:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666d741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.979668:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666d741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.982032:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.982056:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d702 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a985e expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.982067:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.982122:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d702 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a985e expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642291.982140:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d702 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a985e expref: 13 pid: 5861 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642291.982155:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107413760:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642291.982259:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788642291.997606:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642291.998329:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086418816 00000100:00100000:2.0:1788642291.998341:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086418816 00010000:00010000:2.0:1788642291.998386:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d702 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a985e expref: 14 pid: 5861 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642291.998429:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:2.0:1788642291.998438:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:2359:x1875527086418816:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642291.998454:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642291.998462:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d702 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a985e expref: 14 pid: 5861 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.998478:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d702 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a985e expref: 14 pid: 5861 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.998504:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dddc365f500) 00010000:00010000:2.0:1788642291.998510:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.998521:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.998531:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642291.998553:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642291.998623:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:2359:x1875527086418816:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 185us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642291.998640:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 45 00010000:00010000:1.0:1788642292.001688:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666d702 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a985e expref: 13 pid: 5861 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642292.001713:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107413760:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642292.001744:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642292.001755:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642292.001760:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788642292.001983:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788642292.003457:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788642292.003587:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788642292.003667:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1875527107413888:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788642292.003744:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642292.003825:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642292.005672:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107413888 00000100:00100000:2.0:1788642292.005684:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107413888 00000100:00100000:2.0:1788642292.005750:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788642292.005762:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1875527107413888:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788642292.005894:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1875527107413888:12345-0@lo:1000:mdt00_001.0 Request processed in 123us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642292.005903:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788642292.006007:0:5862:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788642292.006013:0:5862:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dddc5dcd180, transno 4294967303 00000100:00100000:1.0:1788642292.006033:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1875527107413888:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788642292.007029:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788642292.007178:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1875527107414016:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788642292.007365:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642292.007438:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788642292.021048:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107414016 00000100:00100000:2.0:1788642292.021063:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107414016 00000100:00100000:3.0:1788642292.021289:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788642292.021301:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5862:x1875527107414016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788642292.021597:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5862:x1875527107414016:12345-0@lo:1000:mdt00_001.0 Request processed in 298us (14231us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788642292.021606:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788642292.021864:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1875527107414016:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788642292.021919:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.021930:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.021938:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.021945:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642292.021950:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.021958:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.021975:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dddc365f500) 00010000:00010000:2.0:1788642292.021978:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788642292.021994:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022001:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d400/0x4ae1ee156666d748 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022042:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d67d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022049:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d67d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022055:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d67d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022060:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642292.022063:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d67d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022069:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d67d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022076:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5400) 00010000:00010000:2.0:1788642292.022079:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788642292.022082:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d67d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022088:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc9833400/0x4ae1ee156666d67d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022133:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022148:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9842 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022163:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022294:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9842 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.022310:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9842 expref: 16 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642292.022323:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb59ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107414144:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788642292.022434:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72180 going to sleep for 11 seconds 00000100:00100000:2.0:1788642292.040225:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642292.040276:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb59ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107414144:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642292.040303:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642292.040347:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086418944 00000100:00100000:2.0:1788642292.040354:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086418944 00010000:00010000:2.0:1788642292.040388:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9842 expref: 17 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642292.040422:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:2.0:1788642292.040431:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+17:2360:x1875527086418944:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642292.040445:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642292.040452:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9842 expref: 17 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040482:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9842 expref: 17 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040505:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d699 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9842 expref: 17 pid: 5863 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040521:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5400) 00010000:00010000:2.0:1788642292.040526:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040535:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040542:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040561:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642292.040607:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:2360:x1875527086418944:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 177us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642292.040614:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 46 00010000:00010000:2.0:1788642292.040637:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040643:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040654:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040671:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040678:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040683:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1a00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642292.040688:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040695:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040704:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5400) 00010000:00010000:2.0:1788642292.040707:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642292.040711:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040717:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d74f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040728:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666d741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040733:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666d741 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040738:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666d741 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040742:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642292.040752:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666d741 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040757:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666d741 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040765:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde02b5400) 00010000:00010000:2.0:1788642292.040767:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788642292.040770:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666d741 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.040775:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666d741 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642292.040988:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:10469:x1875527086418688:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 61597us (61898us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788642292.040996:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 83 00000020:00080000:2.0:1788642292.041000:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788642292.041157:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642292.041162:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642292.041208:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788642292.041219:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788642292.048095:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642292.048519:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086419200 00000100:00100000:2.0:1788642292.048531:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086419200 00000100:00100000:2.0:1788642292.048600:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:2.0:1788642292.048611:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:10469:x1875527086419200:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788642292.049433:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788642292.049550:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788642292.049596:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d756 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.049625:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.049637:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.049646:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d756 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.049653:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d756 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.049659:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d756 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642292.049675:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788642292.049787:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+17:10469:x1875527086419200:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 1174us (1701us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788642292.049796:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00000020:00080000:2.0:1788642292.049801:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788642292.050124:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642292.050131:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d756 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642292.050139:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642292.050144:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d756 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642292.050153:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d756 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642292.050167:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dddc98d9800) 00010000:00010000:1.0:1788642292.050170:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788642292.050175:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d756 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642292.050182:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d756 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642292.050201:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642292.050203:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642292.050205:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642292.413724:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107414528:0@lo:400:kworker.0 00000100:00100000:1.0:1788642292.413801:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642292.414147:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107414656:0@lo:400:kworker.0 00000100:00100000:2.0:1788642292.414187:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642292.414241:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788642292.414256:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107414272:0@lo:400:kworker.0 00000100:00100000:2.0:1788642292.414287:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642292.414306:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107414784:0@lo:400:kworker.0 00000100:00100000:2.0:1788642292.414326:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642292.414379:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107414528 00000100:00100000:2.0:1788642292.414401:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107414528 00000100:00100000:2.0:1788642292.414448:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107414784 00000100:00100000:2.0:1788642292.414450:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107414784 00000100:00100000:2.0:1788642292.414470:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788642292.414478:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107414528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642292.414523:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107414528:12345-0@lo:400:kworker.0 Request processed in 46us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642292.414530:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788642292.414544:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788642292.414549:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107414784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642292.414573:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107414784:12345-0@lo:400:kworker.0 Request processed in 24us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642292.414578:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788642292.414612:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107414784:0@lo:400:kworker.0 00000100:00100000:3.0:1788642292.414994:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107414656 00000100:00100000:3.0:1788642292.414999:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107414656 00000100:00100000:3.0:1788642292.415040:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788642292.415046:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1875527107414656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642292.415088:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1875527107414656:12345-0@lo:400:kworker.0 Request processed in 42us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642292.415093:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788642292.415154:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107414272 00000100:00100000:3.0:1788642292.415158:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107414272 00000100:00100000:3.0:1788642292.415180:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788642292.415186:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc50c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3319:x1875527107414272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642292.415212:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc50c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3319:x1875527107414272:12345-0@lo:400:kworker.0 Request processed in 27us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642292.415218:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:3.0:1788642292.415240:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788642292.415244:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642292.415543:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107414272:0@lo:400:kworker.0 00000100:00100000:3.0:1788642292.415558:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107414656:0@lo:400:kworker.0 00000100:00100000:1.0:1788642292.415678:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107414528:0@lo:400:kworker.0 00000100:00100000:1.0:1788642292.415693:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788642292.415702:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107414400:0@lo:400:kworker.0 00000100:00100000:1.0:1788642292.415734:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642292.415974:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107414400 00000100:00100000:3.0:1788642292.415979:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107414400 00000100:00100000:3.0:1788642292.416027:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788642292.416033:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107414400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642292.416067:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107414400:12345-0@lo:400:kworker.0 Request processed in 35us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642292.416073:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788642292.416471:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107414400:0@lo:400:kworker.0 00010000:00010000:1.0:1788642292.667867:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642292.927458:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107414912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788642292.927542:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642292.927670:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107414912 00000100:00100000:0.0:1788642292.927691:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107414912 00000100:00100000:0.0:1788642292.927745:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788642292.927754:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875527107414912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788642292.927788:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642292.927837:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875527107414912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642292.927856:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788642292.927898:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107414912:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788642293.537531:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1788642293.537556:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:3.0:1788642293.690276:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642293.950905:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107415040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642293.950999:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642293.951127:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107415040 00000100:00100000:3.0:1788642293.951136:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107415040 00000100:00100000:3.0:1788642293.951215:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788642293.951226:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107415040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642293.951263:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642293.951306:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107415040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642293.951313:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788642293.952629:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788642293.952638:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1788642293.952657:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dddc2f98380, transno 4294967301 00000100:00100000:3.0:1788642293.952684:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107415040:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788642294.027762:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642294.027771:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642294.027833:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788642294.027840:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788642294.242612:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642294.243551:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086419456 00000100:00100000:1.0:1788642294.243563:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086419456 00000100:00100000:1.0:1788642294.243648:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:1.0:1788642294.243660:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+17:10488:x1875527086419456:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642294.243685:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642294.243754:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d75d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a987a expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.243890:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d764 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.243905:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d764 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.243919:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d764 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642294.243929:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788642294.244133:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d75d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a987a expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.244153:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a987a expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.244162:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:1.0:1788642294.244165:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788642294.244169:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50400, rc 0) 00000100:00100000:1.0:1788642294.244244:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:10488:x1875527086419456:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 587us (1645us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788642294.244251:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00080000:3.0:1788642294.247621:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642294.250652:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642294.250803:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086419584 00000100:00100000:0.0:1788642294.250814:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086419584 00000100:00100000:0.0:1788642294.250873:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:0.0:1788642294.250883:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:10488:x1875527086419584:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:0.0:1788642294.250975:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d772 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.250992:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d772 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251006:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d772 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251060:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d779 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251067:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251074:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251347:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d780 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251357:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251364:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788642294.251404:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251416:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d772 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251422:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d772 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251429:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d772 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251434:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5ce00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642294.251438:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d772 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251446:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d772 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251457:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:0.0:1788642294.251460:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642294.251464:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d772 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251477:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666d772 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251488:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251494:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d779 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251499:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251504:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642294.251506:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251511:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d779 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251519:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ddde00fb700) 00010000:00010000:0.0:1788642294.251522:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642294.251525:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d779 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251531:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666d779 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251543:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d780 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251548:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d780 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251561:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251566:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5ca00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642294.251568:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d780 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251573:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d780 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251581:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ddde00fb200) 00010000:00010000:0.0:1788642294.251583:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642294.251586:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d780 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.251591:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666d780 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642294.251678:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:10488:x1875527086419584:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 794us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642294.251686:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:1.0:1788642294.376330:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642294.376380:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086419840 00000100:00100000:2.0:1788642294.376391:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086419840 00000100:00100000:2.0:1788642294.376449:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 86 00000100:00100000:2.0:1788642294.376459:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:10491:x1875527086419840:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642294.376479:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642294.376499:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0c00/0x4ae1ee156666d787 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9881 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.376600:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666d78e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.376615:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666d78e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.376627:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666d78e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.376642:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666d795 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.376649:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666d795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.376656:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666d795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.376931:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d79c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.376940:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.376947:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642294.376958:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788642294.377222:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666d78e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377231:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666d78e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377244:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666d78e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377250:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642294.377254:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666d78e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377262:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666d78e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377274:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:2.0:1788642294.377277:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642294.377281:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666d78e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377287:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666d78e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377299:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666d795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377306:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666d795 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377312:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666d795 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377317:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642294.377320:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666d795 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377336:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666d795 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377345:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dddc98d9b00) 00010000:00010000:2.0:1788642294.377347:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642294.377350:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666d795 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377356:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666d795 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377399:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0c00/0x4ae1ee156666d787 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9881 expref: 22 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377412:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d79c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9881 expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.377419:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9100) 00010000:00010000:2.0:1788642294.377421:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788642294.377423:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0a00, rc 0) 00000100:00100000:2.0:1788642294.377483:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:10491:x1875527086419840:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1024us (1160us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788642294.377491:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 86 00000100:00100000:3.0:1788642294.383809:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642294.384556:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086419968 00000100:00100000:1.0:1788642294.384568:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086419968 00000100:00100000:1.0:1788642294.384630:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 87 00000100:00100000:1.0:1788642294.384641:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:10491:x1875527086419968:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:1.0:1788642294.384729:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.384750:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.384764:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.384812:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.384820:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.384838:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.384845:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50c00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642294.384850:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.384859:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.384872:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9100) 00010000:00010000:1.0:1788642294.384875:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788642294.384881:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.384888:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642294.384983:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:10491:x1875527086419968:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 343us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642294.384991:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 87 00000100:00100000:2.0:1788642294.394303:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642294.394436:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086420224 00000100:00100000:3.0:1788642294.394451:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086420224 00000100:00100000:3.0:1788642294.394544:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:3.0:1788642294.394556:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddddbdcf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:10491:x1875527086420224:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788642294.394877:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddddbdcf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:10491:x1875527086420224:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 322us (591us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788642294.394885:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:3.0:1788642294.464245:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642294.464327:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086420480 00000100:00100000:1.0:1788642294.464338:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086420480 00000100:00100000:1.0:1788642294.464399:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:1.0:1788642294.464408:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:10011:x1875527086420480:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788642294.464431:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642294.464451:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9888 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.464569:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.464583:0:9441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d79c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9881 expref: 23 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.464591:0:9441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.464622:0:9441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d79c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9881 expref: 23 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.464634:0:9441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d79c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9881 expref: 23 pid: 5863 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642294.464647:0:9441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9441:1875527107415168:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642294.464749:0:9441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788642294.468830:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642294.468923:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086420608 00000100:00100000:0.0:1788642294.468932:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086420608 00010000:00010000:0.0:1788642294.468990:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d79c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9881 expref: 24 pid: 5863 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642294.469037:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:0.0:1788642294.469048:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:2360:x1875527086420608:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642294.469065:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642294.469142:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d79c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9881 expref: 24 pid: 5863 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.469160:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d79c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9881 expref: 24 pid: 5863 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.469191:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9100) 00010000:00010000:0.0:1788642294.469197:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.469208:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.469215:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.469377:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788642294.469381:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666d79c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9881 expref: 24 pid: 5863 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642294.469400:0:9441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ed500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9441:1875527107415168:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642294.469434:0:9441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.469442:0:9441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.469459:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642294.469477:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:3.0:1788642294.469512:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:2360:x1875527086420608:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 464us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642294.469521:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 47 00010000:00010000:1.0:1788642294.470808:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9888 expref: 24 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.470835:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9888 expref: 23 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.470844:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9100) 00010000:00010000:1.0:1788642294.470848:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788642294.470851:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51e00, rc 0) 00000100:00100000:1.0:1788642294.470916:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:10011:x1875527086420480:12345-192.168.202.49@tcp:101:bash.0 Request processed in 6509us (6679us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788642294.470924:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:2.0:1788642294.478848:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642294.479466:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086420864 00000100:00100000:1.0:1788642294.479482:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086420864 00000100:00100000:1.0:1788642294.479571:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00100000:1.0:1788642294.479583:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:10011:x1875527086420864:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:1.0:1788642294.479944:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d7c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.479965:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.480219:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788642294.480352:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788642294.480382:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008783ba15 reply state 00000000b3e51fc3 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642294.480394:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788642294.480440:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788642294.480613:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10011:x1875527086420864:12345-192.168.202.49@tcp:36:bash.0 Request processed in 1027us (1773us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788642294.480622:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 89 00000020:00080000:1.0:1788642294.480628:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788642294.484086:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642294.484133:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642294.484654:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086420992 00000100:00100000:1.0:1788642294.484665:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086420992 00000100:00100000:1.0:1788642294.484726:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00100000:1.0:1788642294.484736:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10011:x1875527086420992:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788642294.484759:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642294.484788:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a988f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.484891:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d7c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.484898:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.488534:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a988f expref: 28 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.490400:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a988f expref: 28 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.490444:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9100) 00010000:00010000:1.0:1788642294.490448:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788642294.490452:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50c00, rc 0) 00000100:00100000:1.0:1788642294.490539:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:10011:x1875527086420992:12345-192.168.202.49@tcp:101:bash.0 Request processed in 5801us (6445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642294.490561:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 90 00010000:00010000:2.0:1788642294.490736:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642294.490744:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.490755:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d7c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.490777:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9100) 00010000:00010000:2.0:1788642294.490780:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642294.490784:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d7c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.490790:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d7c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642294.495424:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642294.495761:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086421120 00000100:00100000:2.0:1788642294.495780:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086421120 00000100:00100000:2.0:1788642294.495862:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:2.0:1788642294.495876:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:10011:x1875527086421120:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788642294.495898:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642294.495928:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005598a8a5/0x4ae1ee156666d7d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9896 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788642294.495971:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c83f2, atime: 0x6a9c83f0, ctime: 0x6a9c83f2, blocks: 0xb 00010000:00010000:2.0:1788642294.496020:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=381s v=(0 0) 00010000:00010000:2.0:1788642294.496025:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642294.496034:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005598a8a5/0x4ae1ee156666d7d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9896 expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.496055:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005598a8a5/0x4ae1ee156666d7d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9896 expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.496068:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1000, rc 0) 00000100:00100000:2.0:1788642294.496264:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:10011:x1875527086421120:12345-192.168.202.49@tcp:101:bash.0 Request processed in 391us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642294.496271:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00080000:3.0:1788642294.497241:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788642294.500306:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642294.500634:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086421248 00000100:00100000:1.0:1788642294.500644:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086421248 00002000:00010000:1.0:1788642294.500696:0:6715:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788642294.500702:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddfaa6c000 with x1875527086421248 ext(0->18446744073709551615) 00002000:00010000:1.0:1788642294.500714:0:6715:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddfaa6c000. 00000100:00100000:1.0:1788642294.500746:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:1.0:1788642294.500757:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2362:x1875527086421248:12345-192.168.202.49@tcp:10:bash.0 00002000:00010000:1.0:1788642294.501054:0:6715:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788642294.501057:0:6715:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788642290 -> 1788642294 00002000:00010000:1.0:1788642294.501060:0:6715:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788642288 -> 1788642288 00002000:00010000:1.0:1788642294.501062:0:6715:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788642290 -> 1788642294 00002000:00010000:1.0:1788642294.501065:0:6715:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788642294.501156:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2362:x1875527086421248:12345-192.168.202.49@tcp:10:bash.0 Request processed in 401us (857us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788642294.501164:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00002000:00010000:1.0:1788642294.501168:0:6715:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788642294.501171:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddfaa6c000 with x1875527086421248 ext(0->18446744073709551615) 00002000:00010000:1.0:1788642294.501177:0:6715:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddfaa6c000. 00000100:00100000:1.0:1788642294.650298:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642294.650418:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086421376 00000100:00100000:0.0:1788642294.650432:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086421376 00000100:00100000:0.0:1788642294.650512:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 91 00000100:00100000:0.0:1788642294.650523:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10505:x1875527086421376:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:0.0:1788642294.650621:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d7db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.650641:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d7db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.650655:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d7db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.650688:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d7e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.650695:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.650716:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.651571:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d7e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.651586:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.651595:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788642294.651644:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.651658:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d7db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.651665:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d7db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.651671:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d7db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.651677:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5dc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642294.651681:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d7db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.651697:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d7db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.651711:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:0.0:1788642294.651714:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642294.651719:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d7db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.651725:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666d7db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.651737:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652041:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d7e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652047:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652052:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642294.652055:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652062:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d7e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652071:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ddde00fb200) 00010000:00010000:0.0:1788642294.652073:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642294.652076:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d7e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652093:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666d7e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652209:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652216:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d7e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652222:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652227:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642294.652230:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652236:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d7e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652245:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9100) 00010000:00010000:0.0:1788642294.652247:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642294.652250:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d7e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.652256:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666d7e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642294.652556:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10505:x1875527086421376:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 2030us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642294.652566:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 91 00010000:00010000:1.0:1788642294.714348:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642294.718161:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642294.718642:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086421632 00000100:00100000:3.0:1788642294.718653:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086421632 00000100:00100000:3.0:1788642294.718719:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00100000:3.0:1788642294.718730:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:10508:x1875527086421632:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642294.718770:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642294.718796:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d7f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a989d expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.718890:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d7f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.718905:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.718917:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.718931:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d7fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.718958:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.718965:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719252:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d805 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719263:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719270:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642294.719279:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788642294.719369:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d7f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719377:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d7f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719384:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719390:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0030c00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642294.719395:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d7f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719403:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d7f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719426:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:3.0:1788642294.719428:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642294.719433:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d7f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719438:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d7f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719452:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d7fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719459:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d7fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719466:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719471:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642294.719474:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d7fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719480:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d7fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719487:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ddde02b5e00) 00010000:00010000:3.0:1788642294.719489:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642294.719491:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d7fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.719496:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d7fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.720936:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d7f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a989d expref: 30 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.720968:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d805 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a989d expref: 29 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642294.720979:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9100) 00010000:00010000:3.0:1788642294.720982:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788642294.720985:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031200, rc 0) 00000100:00100000:3.0:1788642294.721660:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:10508:x1875527086421632:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 2927us (3504us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788642294.721670:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00100000:2.0:1788642294.736055:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642294.736781:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086421760 00000100:00100000:1.0:1788642294.736794:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086421760 00000100:00100000:1.0:1788642294.736896:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 93 00000100:00100000:1.0:1788642294.736910:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:10508:x1875527086421760:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:1.0:1788642294.737019:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.737042:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9888 expref: 29 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.737052:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.737136:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9888 expref: 29 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.737154:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9888 expref: 29 pid: 9441 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642294.737172:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107415296:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642294.737297:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788642294.747083:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642294.747232:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086422016 00000100:00100000:3.0:1788642294.747242:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086422016 00000100:00100000:3.0:1788642294.747311:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:3.0:1788642294.747321:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:5613:x1875527086422016:12345-192.168.202.49@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788642294.747693:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:5613:x1875527086422016:12345-192.168.202.49@tcp:35:ldlm_bl.0 Request processed in 371us (620us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788642294.747702:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:2.0:1788642294.748175:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107415296:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642294.748208:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642294.752266:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642294.752376:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086422144 00000100:00100000:2.0:1788642294.752387:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086422144 00010000:00010000:2.0:1788642294.752434:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9888 expref: 31 pid: 9441 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642294.752483:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:2.0:1788642294.752493:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:2360:x1875527086422144:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642294.752510:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642294.752517:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9888 expref: 31 pid: 9441 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.752559:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9888 expref: 31 pid: 9441 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.752581:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d7b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9888 expref: 31 pid: 9441 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.752597:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9100) 00010000:00010000:2.0:1788642294.752602:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.752612:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.752621:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642294.752657:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642294.752712:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:2360:x1875527086422144:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 220us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642294.752720:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 48 00010000:00010000:1.0:1788642294.752879:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.752888:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.752923:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.752931:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.752959:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.752967:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642294.752972:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.752979:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.752990:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9100) 00010000:00010000:1.0:1788642294.752992:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788642294.752995:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.753000:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d813 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642294.753042:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:10508:x1875527086421760:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 16135us (17001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642294.753048:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 93 00000100:00100000:0.0:1788642294.757007:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642294.757144:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086422400 00000100:00100000:3.0:1788642294.757156:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086422400 00000100:00100000:3.0:1788642294.757210:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:3.0:1788642294.757220:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:10508:x1875527086422400:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788642294.757817:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:10508:x1875527086422400:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 594us (818us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788642294.757852:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:0.0:1788642294.916241:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642294.916451:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086422656 00000100:00100000:1.0:1788642294.916462:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086422656 00000100:00100000:1.0:1788642294.916530:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 94 00000100:00100000:1.0:1788642294.916540:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:10519:x1875527086422656:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:1.0:1788642294.916564:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642294.916589:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d81a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98a4 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.916680:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d821 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.916696:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d821 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.916708:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d821 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.916721:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d828 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.916728:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.916735:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917030:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d82f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917040:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d82f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917047:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d82f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642294.917056:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788642294.917183:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d821 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917191:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d821 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917204:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917209:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642294.917214:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917220:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d821 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917231:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:1.0:1788642294.917234:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642294.917239:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d821 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917245:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d821 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917256:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917262:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d828 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917267:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d828 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917271:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642294.917274:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d828 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917290:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d828 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917297:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dddc365f700) 00010000:00010000:1.0:1788642294.917300:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642294.917302:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d828 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917308:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d828 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917360:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d81a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98a4 expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917374:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d82f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98a4 expref: 32 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.917380:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9100) 00010000:00010000:1.0:1788642294.917382:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642294.917385:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51200, rc 0) 00000100:00100000:1.0:1788642294.917456:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+32:10519:x1875527086422656:12345-192.168.202.49@tcp:101:cat.0 Request processed in 918us (1227us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788642294.917464:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 94 00000100:00100000:1.0:1788642294.932778:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642294.937474:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086422912 00000100:00100000:0.0:1788642294.937493:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086422912 00000100:00100000:0.0:1788642294.937583:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:0.0:1788642294.937595:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+32:10519:x1875527086422912:12345-192.168.202.49@tcp:35:cat.0 00000100:00100000:0.0:1788642294.938140:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+33:10519:x1875527086422912:12345-192.168.202.49@tcp:35:cat.0 Request processed in 545us (5371us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788642294.938149:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:0.0:1788642294.987028:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642294.987142:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086423168 00000100:00100000:1.0:1788642294.987150:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086423168 00000100:00100000:1.0:1788642294.987212:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 95 00000100:00100000:1.0:1788642294.987221:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+33:10520:x1875527086423168:12345-192.168.202.49@tcp:36:rm.0 00010000:00010000:1.0:1788642294.987289:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788642294.987316:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d82f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98a4 expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.987338:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d805 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a989d expref: 32 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.987354:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d7cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a988f expref: 31 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.987366:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc98d9100) 00010000:00010000:1.0:1788642294.987496:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788642294.987521:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d83d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.987535:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d83d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.987546:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d83d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.987560:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d844 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.987567:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d844 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.987573:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d844 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.987826:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d84b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.987835:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d84b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.987842:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d84b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788642294.988621:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1788642294.988633:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382449533685ns, next at 383449530939ns, rc = 0 00010000:00010000:1.0:1788642294.988703:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d852 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988713:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988723:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988730:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d852 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988737:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d852 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988754:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d852 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988834:0:5861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788642294.988862:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d84b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988876:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d84b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988882:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d84b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988888:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51e00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642294.988892:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d84b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988902:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d84b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988916:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc365fd00) 00010000:00010000:1.0:1788642294.988919:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788642294.988923:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d84b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988928:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d84b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988948:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d83d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988955:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d83d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988961:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d83d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988966:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642294.988975:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d83d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988982:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d83d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.988991:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:1.0:1788642294.988994:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642294.988996:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d83d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642294.989001:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d83d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788642294.989011:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016e79860 reply state 00000000dc0b94ad transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d844 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642294.989020:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788642294.989902:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+32:10520:x1875527086423168:12345-192.168.202.49@tcp:36:rm.0 Request processed in 2675us (2879us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788642294.989912:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 95 00010000:00010000:0.0:1788642294.995503:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642294.995632:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d852 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.995644:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642294.995648:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d852 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.995659:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d852 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.995676:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dddc365fd00) 00010000:00010000:0.0:1788642294.995680:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788642294.995685:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d852 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.995691:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d852 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642294.995738:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642294.995751:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642294.995753:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642295.001792:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d844 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.001815:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d844 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.001823:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d844 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.001851:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642295.001857:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d844 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.001867:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d844 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.001887:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dddc365f700) 00010000:00010000:2.0:1788642295.001891:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642295.001897:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d844 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.001903:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d844 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642295.092726:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642295.092851:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086423424 00000100:00100000:1.0:1788642295.092865:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086423424 00000100:00100000:1.0:1788642295.092932:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00100000:1.0:1788642295.092943:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:10526:x1875527086423424:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788642295.092969:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642295.092995:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d859 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98ab expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.093180:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d860 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.093214:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d860 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.093227:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d860 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.093243:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d867 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.093250:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.093257:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788642295.094050:0:5863:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788642295.094311:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d86e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.094323:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d86e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.094332:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d86e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.094374:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d860 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.094382:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d860 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.094388:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d860 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.094403:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51e00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642295.094408:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d860 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.094416:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d860 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.094433:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:1.0:1788642295.094436:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642295.094442:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d860 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.094450:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666d860 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788642295.094466:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054aa1eb6 reply state 00000000a9efeab1 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642295.094477:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788642295.095272:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d859 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ab expref: 34 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.095295:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d86e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ab expref: 33 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.095303:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:1.0:1788642295.095306:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642295.095308:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51200, rc 0) 00000100:00100000:1.0:1788642295.095386:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:10526:x1875527086423424:12345-192.168.202.49@tcp:101:bash.0 Request processed in 2443us (2672us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788642295.095402:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 96 00010000:00010000:0.0:1788642295.098509:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d867 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.098542:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d867 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.098549:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d867 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.098555:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50c00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642295.098560:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d867 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.098568:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d867 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.098585:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dddc365ff00) 00010000:00010000:0.0:1788642295.098588:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642295.098593:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d867 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.098599:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d867 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642295.109003:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642295.109082:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086423552 00000100:00100000:3.0:1788642295.109092:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086423552 00000100:00100000:3.0:1788642295.109213:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:3.0:1788642295.109226:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2359:x1875527086423552:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788642295.109248:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642295.109275:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f80e24f/0x4ae1ee156666d87c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98b2 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788642295.109312:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642295.109336:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1788642295.109340:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642295.109351:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f80e24f/0x4ae1ee156666d87c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b2 expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.109373:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f80e24f/0x4ae1ee156666d87c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b2 expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.109387:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031600, rc 0) 00000100:00100000:3.0:1788642295.109459:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086423552:12345-192.168.202.49@tcp:101:bash.0 Request processed in 236us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642295.109467:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00080000:0.0:1788642295.109897:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642295.113396:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642295.113495:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086423680 00000100:00100000:2.0:1788642295.113506:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086423680 00000100:00100000:2.0:1788642295.113586:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:2.0:1788642295.113597:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:10526:x1875527086423680:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788642295.113616:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642295.113638:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98b9 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.113671:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f80e24f/0x4ae1ee156666d87c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b2 expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.113680:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642295.113684:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642295.113705:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.113754:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f80e24f/0x4ae1ee156666d87c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b2 expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.113768:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f80e24f/0x4ae1ee156666d87c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b2 expref: 7 pid: 6712 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642295.113784:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb59bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1875527107415424:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788642295.113888:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0aad000 going to sleep for 11 seconds 00000100:00100000:1.0:1788642295.121136:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642295.121845:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb59bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1875527107415424:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642295.121893:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.121925:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1a00, rc 0) 00000100:00100000:2.0:1788642295.122011:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:10526:x1875527086423680:12345-192.168.202.49@tcp:101:bash.0 Request processed in 8415us (8624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642295.122022:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:3.0:1788642295.125920:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086423808 00000100:00100000:3.0:1788642295.125936:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086423808 00010000:00010000:3.0:1788642295.125986:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f80e24f/0x4ae1ee156666d87c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b2 expref: 7 pid: 6712 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642295.126135:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:3.0:1788642295.126146:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddde4e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086423808:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642295.126162:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642295.126186:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f80e24f/0x4ae1ee156666d87c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b2 expref: 7 pid: 6712 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.126202:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f80e24f/0x4ae1ee156666d87c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b2 expref: 7 pid: 6712 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.126228:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f80e24f/0x4ae1ee156666d87c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b2 expref: 7 pid: 6712 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.126246:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642295.126250:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642295.126260:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.126270:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.126308:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642295.126322:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd783480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5847:1875527107415552:192.168.202.49@tcp:105: 00000100:00100000:3.0:1788642295.126434:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4d66840 going to sleep for 11 seconds 00000100:00100000:3.0:1788642295.134320:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd783480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5847:1875527107415552:192.168.202.49@tcp:105: 00010000:00010000:3.0:1788642295.134347:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642295.134416:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddde4e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2360:x1875527086423808:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 8271us (13288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642295.134428:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:0.0:1788642295.140925:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642295.141028:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086424064 00000100:00100000:3.0:1788642295.141040:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086424064 00000100:00100000:3.0:1788642295.141138:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:3.0:1788642295.141150:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+33:10526:x1875527086424064:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:3.0:1788642295.141729:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:10526:x1875527086424064:12345-192.168.202.49@tcp:35:bash.0 Request processed in 579us (812us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788642295.141748:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:1.0:1788642295.400340:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642295.400511:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086424192 00000100:00100000:2.0:1788642295.400531:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086424192 00000100:00100000:2.0:1788642295.400603:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 97 00000100:00100000:2.0:1788642295.400616:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:10542:x1875527086424192:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642295.400647:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642295.400671:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d88a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98c0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.400812:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666d891 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.400829:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666d891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.400841:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666d891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642295.400875:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788642295.400880:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788642295.400897:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666d891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.400921:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d88a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98c0 expref: 36 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.400940:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666d891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98c0 expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.400948:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:2.0:1788642295.400951:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788642295.400955:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1400, rc 0) 00000100:00100000:2.0:1788642295.401018:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+35:10542:x1875527086424192:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 405us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642295.401025:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 97 00000100:00100000:1.0:1788642295.419184:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642295.419502:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086424448 00000100:00100000:3.0:1788642295.419514:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086424448 00000100:00100000:3.0:1788642295.419584:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 98 00000100:00100000:3.0:1788642295.419597:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+35:10542:x1875527086424448:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642295.419624:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642295.419652:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d898 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98c7 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.419795:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d89f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.419813:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d89f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.419846:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d89f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642295.419860:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788642295.420037:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d898 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98c7 expref: 38 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.420059:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d89f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98c7 expref: 37 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.420068:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:3.0:1788642295.420071:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642295.420076:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031400, rc 0) 00000100:00100000:3.0:1788642295.420279:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:10542:x1875527086424448:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 685us (1104us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788642295.420287:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 98 00000100:00100000:0.0:1788642295.429071:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642295.429183:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642295.429425:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086424704 00000100:00100000:3.0:1788642295.429435:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086424704 00000100:00100000:3.0:1788642295.429510:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:3.0:1788642295.429529:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:2360:x1875527086424704:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642295.429556:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642295.429583:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d89f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98c7 expref: 37 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.429605:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:3.0:1788642295.429611:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642295.429685:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:2360:x1875527086424704:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 157us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642295.429693:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:2.0:1788642295.430896:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086424832 00000100:00100000:2.0:1788642295.430907:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086424832 00000100:00100000:2.0:1788642295.430978:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 99 00000100:00100000:2.0:1788642295.430987:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:10542:x1875527086424832:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642295.431011:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642295.431029:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d8ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98ce expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.431149:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d8b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.431165:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d8b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.431176:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d8b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642295.431188:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788642295.431316:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666d8ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ce expref: 39 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.431335:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d8b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ce expref: 38 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.431343:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:2.0:1788642295.431346:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788642295.431349:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0400, rc 0) 00000100:00100000:2.0:1788642295.431421:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+38:10542:x1875527086424832:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 435us (2375us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788642295.431428:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 99 00000100:00100000:0.0:1788642295.442228:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642295.442478:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086424960 00000100:00100000:3.0:1788642295.442490:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086424960 00000100:00100000:3.0:1788642295.442559:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:3.0:1788642295.442570:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086424960:12345-192.168.202.49@tcp:1:lfs.0 00010000:00010000:3.0:1788642295.442629:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.442652:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.442661:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642295.442665:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788642295.442670:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.442732:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.442748:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 6 pid: 6711 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642295.442764:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd782300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6712:1875527107415680:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642295.442865:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4d66480 going to sleep for 11 seconds 00000100:00100000:0.0:1788642295.447556:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd782300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6712:1875527107415680:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642295.447597:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642295.453379:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642295.454150:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086425088 00000100:00100000:3.0:1788642295.454172:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086425088 00002000:00100000:3.0:1788642295.454217:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8dddeff80000 x1875527086425088/t0(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:496/0 lens 504/0 e 0 to 0 dl 1788642306 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788642295.454228:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddeff80000 with x1875527086425088 ext(0->8) 00010000:00010000:3.0:1788642295.454239:0:6716:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 7 pid: 6711 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.454267:0:6716:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 7 pid: 6711 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788642295.454276:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dddeff80000 00000100:00100000:3.0:1788642295.454370:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:3.0:1788642295.454381:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086425088:12345-192.168.202.49@tcp:4:lfs.0 00000100:00100000:3.0:1788642295.455541:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2359:x1875527086425088:12345-192.168.202.49@tcp:4:lfs.0 Request processed in 1157us (2167us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788642295.455552:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00002000:00100000:3.0:1788642295.455561:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8dddeff80000 x1875527086425088/t4294967302(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:496/0 lens 504/448 e 0 to 0 dl 1788642306 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788642295.455576:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddeff80000 with x1875527086425088 ext(0->8) 00010000:00010000:3.0:1788642295.455585:0:6716:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 9 pid: 6711 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.455600:0:6716:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 9 pid: 6711 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788642295.455620:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dddeff80000 00000100:00100000:3.0:1788642295.459774:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642295.460048:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086425216 00000100:00100000:1.0:1788642295.460069:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086425216 00010000:00010000:1.0:1788642295.460136:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 9 pid: 6711 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642295.460183:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:1.0:1788642295.460193:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2360:x1875527086425216:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642295.460210:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788642295.460232:0:5847:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788642295.460235:0:5847:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788642295 00002000:00010000:1.0:1788642295.460237:0:5847:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788642295 00002000:00010000:1.0:1788642295.460239:0:5847:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788642295 00010000:00010000:1.0:1788642295.460245:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 9 pid: 6711 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.460261:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 9 pid: 6711 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.460285:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d3d5cda/0x4ae1ee156666d883 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98b9 expref: 9 pid: 6711 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.460325:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788642295.460329:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788642295.460336:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.460346:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.460394:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642295.460556:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.460565:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.460599:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.460607:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.460615:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.460622:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031400 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642295.460626:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.460649:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.460663:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642295.460671:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666d8c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642295.460760:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086425216:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 567us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642295.460770:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:0.0:1788642295.465866:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2362:x1875527086424960:12345-192.168.202.49@tcp:1:lfs.0 Request processed in 23283us (23639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642295.465883:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:0.0:1788642295.472295:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642295.473604:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086425472 00000100:00100000:3.0:1788642295.473619:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086425472 00000100:00100000:3.0:1788642295.473856:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:3.0:1788642295.473870:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddddbdcc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+38:10542:x1875527086425472:12345-192.168.202.49@tcp:35:lfs.0 00000004:00010000:3.0:1788642295.473949:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d8b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ce expref: 38 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788642295.474270:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788642295.474307:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788642295.474613:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788642295.474664:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.474680:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d86e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ab expref: 42 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.474691:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.474859:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d86e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ab expref: 42 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.474874:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d86e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ab expref: 42 pid: 5863 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642295.474900:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd780380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1875527107415808:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642295.474988:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4d66600 going to sleep for 11 seconds 00000100:00100000:3.0:1788642295.477537:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd780380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1875527107415808:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788642295.477567:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642295.485245:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642295.485343:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086425600 00000100:00100000:2.0:1788642295.485371:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086425600 00010000:00010000:2.0:1788642295.485408:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d86e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ab expref: 43 pid: 5863 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642295.485455:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:2.0:1788642295.485464:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+43:2361:x1875527086425600:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642295.485479:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642295.485486:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d86e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ab expref: 43 pid: 5863 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.485501:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d86e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ab expref: 43 pid: 5863 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.485535:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d86e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ab expref: 43 pid: 5863 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.485562:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:2.0:1788642295.485568:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.485578:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.485586:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.485617:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642295.485677:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+42:2361:x1875527086425600:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 213us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642295.485695:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 51 00010000:00010000:3.0:1788642295.486091:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.486148:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788642295.486283:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788642295.486501:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788642295.486818:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd780380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875527107415936:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788642295.486883:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642295.486923:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4d66000 going to sleep for 11 seconds 00000100:00100000:0.0:1788642295.487081:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107415936 00000100:00100000:0.0:1788642295.487088:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107415936 00000100:00100000:0.0:1788642295.487172:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788642295.487181:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875527107415936:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788642295.487259:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875527107415936:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642295.487266:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788642295.487805:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd780380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875527107415936:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788642295.488306:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788642295.488374:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb59bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875527107416064:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788642295.488417:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642295.488438:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc7038d80 going to sleep for 11 seconds 00000100:00080000:3.0:1788642295.488638:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788642295.488749:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107416064 00000100:00100000:0.0:1788642295.488761:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107416064 00000100:00100000:0.0:1788642295.488802:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788642295.488810:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875527107416064:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788642295.488982:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5864:x1875527107416064:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 173us (564us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788642295.488990:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788642295.489955:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb59bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875527107416064:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788642295.490032:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1788642295.490076:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.490087:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.490095:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.490137:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642295.490142:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.490151:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.490167:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:3.0:1788642295.490170:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788642295.490175:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.490182:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788642295.490380:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788642295.490467:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1788642295.490478:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382951379372ns, next at 383951376450ns, rc = 0 00000001:00080000:3.0:1788642295.490485:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1788642295.490532:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:3.0:1788642295.490535:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788642295.490596:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d8b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ce expref: 46 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642295.491311:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddddbdcc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+45:10542:x1875527086425472:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 17441us (19025us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1788642295.491322:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 26 00000020:00080000:3.0:1788642295.491328:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788642295.496366:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642295.496482:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086425728 00000100:00100000:3.0:1788642295.496494:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086425728 00000100:00100000:3.0:1788642295.496576:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00100000:3.0:1788642295.496587:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+45:10542:x1875527086425728:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642295.496613:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642295.496638:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d8d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98d5 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.496836:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d8d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98d5 expref: 46 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.496856:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d8d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98d5 expref: 46 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.496877:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642295.496880:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788642295.496884:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0030c00, rc 0) 00000100:00100000:3.0:1788642295.496948:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+46:10542:x1875527086425728:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 364us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642295.496955:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00100000:2.0:1788642295.501383:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642295.501490:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086425984 00000100:00100000:0.0:1788642295.501499:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086425984 00000100:00100000:0.0:1788642295.501570:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:0.0:1788642295.501581:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+46:10542:x1875527086425984:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788642295.501892:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+47:10542:x1875527086425984:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 312us (518us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788642295.501901:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:0.0:1788642295.616294:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642295.616417:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086426112 00000100:00100000:2.0:1788642295.616427:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086426112 00000100:00100000:2.0:1788642295.616484:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 101 00000100:00100000:2.0:1788642295.616494:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+47:10553:x1875527086426112:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:2.0:1788642295.616584:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d8d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616602:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616615:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616630:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d8de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616637:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d8de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616644:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d8de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616792:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d8e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616801:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616807:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788642295.616850:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616862:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d8d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616868:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d8d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616875:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616880:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1e00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642295.616884:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d8d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616891:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d8d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616902:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:2.0:1788642295.616905:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642295.616909:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d8d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616922:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d8d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616936:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d8de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616941:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d8de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616946:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d8de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616951:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642295.616954:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d8de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616959:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d8de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616966:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dddc98d9a00) 00010000:00010000:2.0:1788642295.616968:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642295.616971:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d8de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616976:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d8de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616989:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.616995:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.617005:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.617010:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642295.617013:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.617019:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.617026:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:2.0:1788642295.617028:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642295.617031:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d8e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.617037:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d8e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642295.617179:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+47:10553:x1875527086426112:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 685us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642295.617188:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 101 00000100:00100000:1.0:1788642295.673779:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642295.673876:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086426368 00000100:00100000:3.0:1788642295.673888:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086426368 00000100:00100000:3.0:1788642295.673957:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 102 00000100:00100000:3.0:1788642295.673969:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+47:10556:x1875527086426368:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642295.673992:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642295.674014:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98dc expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674142:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d8f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674158:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d8f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674170:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d8f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674189:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d8fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674197:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d8fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674203:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d8fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674327:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d901 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674336:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674354:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d901 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642295.674364:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788642295.674461:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d8f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674468:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d8f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674480:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d8f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674486:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642295.674490:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d8f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674498:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d8f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674510:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:3.0:1788642295.674513:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642295.674518:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d8f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674524:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d8f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674540:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d8fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674546:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d8fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674553:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d8fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674557:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642295.674560:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d8fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674577:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d8fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674586:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ddde02b5400) 00010000:00010000:3.0:1788642295.674589:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642295.674592:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d8fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674597:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d8fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674642:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d8ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98dc expref: 50 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674656:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d901 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98dc expref: 49 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.674663:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642295.674665:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642295.674668:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031200, rc 0) 00000100:00100000:3.0:1788642295.674742:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+49:10556:x1875527086426368:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 775us (977us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788642295.674750:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 102 00000100:00100000:3.0:1788642295.681610:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642295.681848:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086426496 00000100:00100000:2.0:1788642295.681858:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086426496 00000100:00100000:2.0:1788642295.681934:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 103 00000100:00100000:2.0:1788642295.681943:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+49:10556:x1875527086426496:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:2.0:1788642295.682017:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d90f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.682035:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.682062:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.682090:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d90f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.682138:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d90f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.682146:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d90f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.682152:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642295.682157:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d90f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.682165:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d90f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.682177:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:2.0:1788642295.682180:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788642295.682185:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d90f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.682191:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d90f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642295.682256:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+49:10556:x1875527086426496:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 313us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642295.682263:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 103 00000100:00100000:0.0:1788642295.699293:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642295.699415:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086426752 00000100:00100000:1.0:1788642295.699425:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086426752 00000100:00100000:1.0:1788642295.699489:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:1.0:1788642295.699500:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+49:10556:x1875527086426752:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:1.0:1788642295.699766:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+50:10556:x1875527086426752:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 267us (483us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788642295.699775:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 28 00010000:00010000:3.0:1788642295.738812:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642295.848807:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642295.849030:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086427008 00000100:00100000:3.0:1788642295.849039:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086427008 00000100:00100000:3.0:1788642295.849120:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 104 00000100:00100000:3.0:1788642295.849149:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+50:10566:x1875527086427008:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788642295.849174:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642295.849178:0:9441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788642295.849216:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666d891 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98c0 expref: 50 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.849246:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:3.0:1788642295.849252:0:9441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642295.849274:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d916 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98e3 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.849391:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d91d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.849405:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d91d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.849414:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d91d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642295.849424:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788642295.849910:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d916 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98e3 expref: 52 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.849928:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d91d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98e3 expref: 51 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642295.849936:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642295.849938:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642295.849949:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031400, rc 0) 00000100:00100000:3.0:1788642295.850026:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+51:10566:x1875527086427008:12345-192.168.202.49@tcp:101:bash.0 Request processed in 879us (1229us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788642295.850033:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 104 00000100:00100000:2.0:1788642295.855645:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642295.855836:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086427264 00000100:00100000:1.0:1788642295.855847:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086427264 00000100:00100000:1.0:1788642295.855920:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 105 00000100:00100000:1.0:1788642295.855930:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+51:10566:x1875527086427264:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:1.0:1788642295.856019:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788642295.856047:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d91d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98e3 expref: 51 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.856070:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d901 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98dc expref: 50 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.856081:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:1.0:1788642295.856089:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788642295.856639:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d92b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.856657:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d92b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.856667:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d92b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788642295.856734:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788642295.856760:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9fa2368 reply state 00000000fb86af87 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d92b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642295.856769:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788642295.856938:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:10566:x1875527086427264:12345-192.168.202.49@tcp:36:bash.0 Request processed in 1007us (1301us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788642295.856945:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 105 00000020:00080000:1.0:1788642295.856950:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788642295.867995:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d92b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.868012:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d92b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.868019:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d92b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.868024:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642295.868029:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d92b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.868036:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d92b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.868055:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:2.0:1788642295.868058:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642295.868063:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d92b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.868069:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d92b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642295.868881:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642295.869001:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086427392 00000100:00100000:1.0:1788642295.869011:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086427392 00000100:00100000:1.0:1788642295.869061:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 106 00000100:00100000:1.0:1788642295.869087:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+51:10566:x1875527086427392:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788642295.869148:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642295.869167:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d932 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98ea expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.869259:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d939 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.869284:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.869294:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642295.869322:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788642295.869325:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642295.869344:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d939 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.869369:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666d932 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ea expref: 53 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.869384:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d939 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ea expref: 52 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642295.869391:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:1.0:1788642295.869394:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642295.869396:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50800, rc 0) 00000100:00100000:1.0:1788642295.869457:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:10566:x1875527086427392:12345-192.168.202.49@tcp:101:bash.0 Request processed in 374us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642295.869473:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 106 00000100:00100000:0.0:1788642295.874177:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642295.874281:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086427648 00000100:00100000:1.0:1788642295.874290:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086427648 00000100:00100000:1.0:1788642295.874351:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:1.0:1788642295.874361:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:10566:x1875527086427648:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:1.0:1788642295.874594:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+53:10566:x1875527086427648:12345-192.168.202.49@tcp:35:bash.0 Request processed in 233us (426us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788642295.874602:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:1.0:1788642295.999432:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642295.999659:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086427776 00000100:00100000:2.0:1788642295.999673:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086427776 00000100:00100000:2.0:1788642295.999753:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 107 00000100:00100000:2.0:1788642295.999765:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+53:10572:x1875527086427776:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642295.999791:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642295.999817:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98f1 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.999915:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d947 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.999935:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642295.999952:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642295.999997:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788642296.000001:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788642296.000021:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.000049:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98f1 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.000070:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98f1 expref: 54 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.000079:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:2.0:1788642296.000082:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788642296.000086:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0e00, rc 0) 00000100:00100000:2.0:1788642296.000497:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:10572:x1875527086427776:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 732us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.000505:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 107 00000100:00100000:2.0:1788642296.017276:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642296.017556:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086427904 00000100:00100000:3.0:1788642296.017566:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086427904 00000100:00100000:3.0:1788642296.017689:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 108 00000100:00100000:3.0:1788642296.017713:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:10572:x1875527086427904:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642296.017734:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642296.017755:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d94e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98f8 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.017829:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d955 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.017845:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d955 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.017857:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d955 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.017871:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d95c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.017878:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d95c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.017885:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d95c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.017978:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d963 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018002:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018010:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642296.018047:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788642296.018051:0:9441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642296.018085:0:9441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018122:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018132:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d955 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018139:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d955 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018145:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d955 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018151:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642296.018155:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d955 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018164:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d955 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018176:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:3.0:1788642296.018179:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642296.018191:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d955 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018198:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666d955 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018213:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d95c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018219:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d95c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018224:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d95c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018230:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642296.018233:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d95c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018239:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d95c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018248:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ddde02b5400) 00010000:00010000:3.0:1788642296.018250:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642296.018253:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d95c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018259:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666d95c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018290:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666d94e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98f8 expref: 56 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018317:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98f8 expref: 55 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.018338:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642296.018341:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642296.018344:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031400, rc 0) 00000100:00100000:3.0:1788642296.018936:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:10572:x1875527086427904:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1222us (1666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642296.018946:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 108 00000100:00080000:0.0:1788642296.024334:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642296.028593:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642296.028769:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642296.028842:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086428288 00000100:00100000:3.0:1788642296.028851:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086428288 00000100:00100000:3.0:1788642296.028933:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:3.0:1788642296.028955:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:2360:x1875527086428288:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642296.028971:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642296.028998:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666d963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98f8 expref: 55 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.029023:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642296.029028:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642296.029093:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:2360:x1875527086428288:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 151us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642296.029134:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:1.0:1788642296.033454:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086428160 00000100:00100000:1.0:1788642296.033473:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086428160 00000100:00100000:0.0:1788642296.033762:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 109 00000100:00100000:0.0:1788642296.033775:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:10572:x1875527086428160:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788642296.033799:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642296.033823:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d600/0x4ae1ee156666d96a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a98ff expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.033938:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.033955:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d939 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ea expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.033982:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.034020:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d939 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ea expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.034034:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d939 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ea expref: 55 pid: 5863 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642296.034048:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc2f9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107416192:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642296.034186:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72300 going to sleep for 11 seconds 00000100:00100000:2.0:1788642296.044195:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc2f9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107416192:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642296.044243:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642296.047795:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642296.047902:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086428416 00000100:00100000:1.0:1788642296.047912:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086428416 00010000:00010000:1.0:1788642296.047953:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d939 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ea expref: 56 pid: 5863 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642296.047992:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:1.0:1788642296.048001:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:2360:x1875527086428416:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642296.048014:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642296.048020:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d939 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ea expref: 56 pid: 5863 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.048033:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d939 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ea expref: 56 pid: 5863 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.048055:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666d939 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ea expref: 56 pid: 5863 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.048084:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:1.0:1788642296.048089:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.048140:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.048149:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.048176:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642296.048222:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:2360:x1875527086428416:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 222us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642296.048229:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 52 00010000:00010000:2.0:1788642296.048361:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.048370:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642296.048397:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788642296.048541:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d600/0x4ae1ee156666d96a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ff expref: 56 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.048559:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ff expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.048566:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:2.0:1788642296.048569:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788642296.048571:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5cc00, rc 0) 00000100:00100000:2.0:1788642296.048617:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:10572:x1875527086428160:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 14845us (20036us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788642296.048623:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 109 00000100:00100000:0.0:1788642296.054298:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.054410:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086428672 00000100:00100000:2.0:1788642296.054423:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086428672 00000100:00100000:2.0:1788642296.054506:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:2.0:1788642296.054518:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:10572:x1875527086428672:12345-192.168.202.49@tcp:103:lfs.0 00010000:00010000:2.0:1788642296.054535:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642296.054564:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666d8d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98d5 expref: 55 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.054605:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:2.0:1788642296.054611:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642296.054675:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:10572:x1875527086428672:12345-192.168.202.49@tcp:103:lfs.0 Request processed in 159us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.054685:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:1.0:1788642296.057857:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.058203:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086428800 00000100:00100000:2.0:1788642296.058214:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086428800 00000100:00100000:2.0:1788642296.058273:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 110 00000100:00100000:2.0:1788642296.058283:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:10572:x1875527086428800:12345-192.168.202.49@tcp:58:lfs.0 00010000:00010000:2.0:1788642296.058411:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d97f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.058429:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d97f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.058441:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d97f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788642296.058639:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788642296.058729:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:10572:x1875527086428800:12345-192.168.202.49@tcp:58:lfs.0 Request processed in 447us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.058737:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 110 00000100:00100000:3.0:1788642296.062200:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.062289:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086428928 00000100:00100000:2.0:1788642296.062299:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086428928 00000100:00100000:2.0:1788642296.062369:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 111 00000100:00100000:2.0:1788642296.062380:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:10572:x1875527086428928:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642296.062400:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642296.062432:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d986 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9906 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.062501:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d97f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.062513:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d986 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9906 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.062533:0:5862:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d97f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.062546:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d986 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9906 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.062559:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:2.0:1788642296.062562:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788642296.062566:0:5862:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d986 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9906 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.062573:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0000, rc 0) 00000100:00100000:2.0:1788642296.062700:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:10572:x1875527086428928:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 314us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.062707:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 111 00000040:00080000:0.0:1788642296.186882:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788642296.186894:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788642296.186942:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788642296.186949:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788642296.201869:0:11714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddefface00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11714:1875527107416320:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788642296.201987:0:11714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5f88e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788642296.213409:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642296.213442:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086429056 00000100:00100000:0.0:1788642296.213452:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086429056 00000100:00100000:0.0:1788642296.213506:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 112 00000100:00100000:0.0:1788642296.213516:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:10573:x1875527086429056:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788642296.213555:0:5863:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788642296.213678:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:10573:x1875527086429056:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 163us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642296.213697:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 112 00000100:00100000:3.0:1788642296.219520:0:11714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddefface00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11714:1875527107416320:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788642296.220768:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642296.220989:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086429184 00000100:00100000:1.0:1788642296.220998:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086429184 00000100:00100000:1.0:1788642296.221059:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 113 00000100:00100000:1.0:1788642296.221070:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:10573:x1875527086429184:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788642296.221195:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d98d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221215:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d98d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221228:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d98d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221674:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d994 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221701:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d994 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221710:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d994 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221735:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d99b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221745:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221751:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642296.221794:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788642296.221798:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642296.221815:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221828:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d98d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221835:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d98d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221842:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d98d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221847:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642296.221852:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d98d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221867:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d98d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221881:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365f900) 00010000:00010000:1.0:1788642296.221884:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642296.221891:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d98d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221897:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d98d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221912:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d994 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221917:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d994 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221922:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d994 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221927:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642296.221930:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d994 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221934:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d994 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.221941:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8dddc365f100) 00010000:00010000:1.0:1788642296.221943:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642296.221946:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d994 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.222016:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d994 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.222044:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.222051:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d99b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.222056:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d99b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.222061:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642296.222065:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d99b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.222071:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d99b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.222078:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:1.0:1788642296.222080:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642296.222083:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d99b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.222088:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d99b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642296.222619:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:10573:x1875527086429184:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 Request processed in 1544us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642296.222632:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 113 00000100:00100000:0.0:1788642296.242861:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.243522:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086429440 00000100:00100000:2.0:1788642296.243535:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086429440 00000100:00100000:2.0:1788642296.243608:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 114 00000100:00100000:2.0:1788642296.243619:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:10573:x1875527086429440:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788642296.243641:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642296.243676:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d9a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a990d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.243830:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.243845:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.243857:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642296.243869:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788642296.243975:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.243984:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.243991:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.243997:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642296.244002:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.244011:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.244023:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:2.0:1788642296.244026:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788642296.244031:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.244048:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.244095:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d9a2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a990d expref: 57 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.244135:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365f900) 00010000:00010000:2.0:1788642296.244138:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788642296.244142:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d9a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a990d expref: 57 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.244151:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0800, rc 0) 00000100:00100000:2.0:1788642296.244235:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:10573:x1875527086429440:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 618us (1385us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788642296.244243:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 114 00000100:00100000:3.0:1788642296.247208:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642296.247561:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086429568 00000100:00100000:0.0:1788642296.247573:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086429568 00000100:00100000:0.0:1788642296.247631:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 115 00000100:00100000:0.0:1788642296.247642:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:10573:x1875527086429568:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788642296.247680:0:5861:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788642296.247865:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:10573:x1875527086429568:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 223us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642296.247874:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 115 00000100:00100000:3.0:1788642296.261003:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642296.261888:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086429824 00000100:00100000:0.0:1788642296.261900:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086429824 00000100:00100000:0.0:1788642296.261971:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 116 00000100:00100000:0.0:1788642296.261981:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:10573:x1875527086429824:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788642296.262002:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642296.262005:0:9441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788642296.262035:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666d947 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98f1 expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.262058:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:0.0:1788642296.262069:0:9441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642296.262083:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666d9b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9914 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788642296.264844:0:9441:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788642296.265154:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d9be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.265174:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.265188:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.265259:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666d9b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9914 expref: 58 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.265280:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d9be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9914 expref: 57 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.265288:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:1.0:1788642296.265291:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642296.265295:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51200, rc 0) 00000100:00100000:1.0:1788642296.265381:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+57:10573:x1875527086429824:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 3401us (4387us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788642296.265391:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 116 00000100:00100000:2.0:1788642296.278922:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642296.279032:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086430080 00000100:00100000:1.0:1788642296.279042:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086430080 00000100:00100000:1.0:1788642296.279145:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 117 00000100:00100000:1.0:1788642296.279156:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+57:10573:x1875527086430080:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788642296.279220:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642296.279248:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d9be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9914 expref: 57 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279289:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:1.0:1788642296.279305:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788642296.279327:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279341:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279351:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279401:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe0ac8f35 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279410:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0ac8f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279417:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0ac8f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279479:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279486:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279494:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279499:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642296.279504:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279517:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279527:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:1.0:1788642296.279530:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642296.279534:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279540:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279550:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0ac8f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279556:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0ac8f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279561:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0ac8f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279566:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642296.279569:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0ac8f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279575:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0ac8f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279582:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe0ac8f35 (ffff8dddc365fa00) 00010000:00010000:1.0:1788642296.279585:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642296.279587:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe0ac8f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.279604:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe0ac8f35 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642296.279698:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:10573:x1875527086430080:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 543us (786us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788642296.279708:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 117 00000100:00100000:3.0:1788642296.283793:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.284195:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086430208 00000100:00100000:2.0:1788642296.284205:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086430208 00000100:00100000:2.0:1788642296.284268:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 118 00000100:00100000:2.0:1788642296.284278:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:10573:x1875527086430208:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788642296.284300:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642296.284321:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d9da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a991b expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.284357:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.284487:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.284502:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.284598:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666d9da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a991b expref: 58 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.284618:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a991b expref: 57 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.284627:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc98d9a00) 00010000:00010000:2.0:1788642296.284629:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788642296.284633:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0400, rc 0) 00000100:00100000:2.0:1788642296.284711:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+57:10573:x1875527086430208:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 434us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.284719:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 118 00000100:00100000:3.0:1788642296.294176:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.294331:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086430464 00000100:00100000:2.0:1788642296.294341:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086430464 00000100:00100000:2.0:1788642296.294412:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 119 00000100:00100000:2.0:1788642296.294423:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+57:10573:x1875527086430464:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788642296.294531:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d9e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.294551:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.294584:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788642296.294865:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788642296.294875:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383755775559ns, next at 384755772874ns, rc = 0 00000004:00010000:2.0:1788642296.294960:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e255d44e reply state 000000003a700541 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642296.294971:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788642296.295078:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:10573:x1875527086430464:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 655us (910us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788642296.295085:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 119 00010000:00010000:2.0:1788642296.298217:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.298237:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d9e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.298245:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d9e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.298251:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1a00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642296.298256:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d9e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.298263:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d9e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.298280:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc98d9a00) 00010000:00010000:2.0:1788642296.298283:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788642296.298304:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d9e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.298311:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1a00/0x4ae1ee156666d9e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642296.300905:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642296.301412:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086430592 00000100:00100000:1.0:1788642296.301423:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086430592 00000100:00100000:1.0:1788642296.301483:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:1.0:1788642296.301493:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+58:10573:x1875527086430592:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788642296.301516:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642296.301537:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9922 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.301600:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9922 expref: 59 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.301615:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9922 expref: 59 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.301635:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc98d9a00) 00010000:00010000:1.0:1788642296.301638:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788642296.301641:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51000, rc 0) 00000100:00100000:1.0:1788642296.301716:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:10573:x1875527086430592:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 224us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642296.301722:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 120 00000100:00100000:3.0:1788642296.313306:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642296.314507:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086430720 00000100:00100000:0.0:1788642296.314537:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086430720 00000100:00100000:0.0:1788642296.314630:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:0.0:1788642296.314641:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2361:x1875527086430720:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788642296.314996:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2361:x1875527086430720:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 357us (4260us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788642296.315004:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00080000:3.0:1788642296.315536:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788642296.328756:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642296.328897:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086430976 00000100:00100000:1.0:1788642296.328907:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086430976 00000100:00100000:1.0:1788642296.328968:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:1.0:1788642296.328983:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:10573:x1875527086430976:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788642296.329259:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:10573:x1875527086430976:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 277us (520us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788642296.329268:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:1.0:1788642296.340089:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.346370:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086431232 00000100:00100000:2.0:1788642296.346387:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086431232 00000100:00100000:0.0:1788642296.347573:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 121 00000100:00100000:0.0:1788642296.347586:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:10573:x1875527086431232:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788642296.347766:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:10573:x1875527086431232:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 181us (7686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642296.348003:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 121 00000100:00100000:2.0:1788642296.360336:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642296.360499:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086431360 00000100:00100000:1.0:1788642296.360512:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086431360 00000100:00100000:1.0:1788642296.360589:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 122 00000100:00100000:1.0:1788642296.360600:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:10573:x1875527086431360:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788642296.360627:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642296.360653:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d9f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9929 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.360748:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.360766:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.360780:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642296.360829:0:9441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642296.360851:0:9441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.360898:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666d9f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9929 expref: 62 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.360920:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9929 expref: 61 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.360929:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc98d9a00) 00010000:00010000:1.0:1788642296.360932:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788642296.360936:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51600, rc 0) 00000100:00100000:1.0:1788642296.361010:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:10573:x1875527086431360:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 411us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642296.361018:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 122 00000100:00100000:3.0:1788642296.366785:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.368154:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086431488 00000100:00100000:2.0:1788642296.368167:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086431488 00000100:00100000:2.0:1788642296.368219:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:2.0:1788642296.368228:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2359:x1875527086431488:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788642296.368254:0:9442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642296.368274:0:9442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000517881b2/0x4ae1ee156666da04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9930 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788642296.368300:0:9442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c83f8, blocks: 0x1 00010000:00010000:2.0:1788642296.368318:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1788642296.368322:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642296.368330:0:9442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000517881b2/0x4ae1ee156666da04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9930 expref: 10 pid: 9442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.368347:0:9442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000517881b2/0x4ae1ee156666da04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9930 expref: 10 pid: 9442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.368361:0:9442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0800, rc 0) 00000100:00100000:2.0:1788642296.368427:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:2359:x1875527086431488:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 200us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.368448:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:3.0:1788642296.378965:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642296.382827:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086431744 00000100:00100000:1.0:1788642296.382843:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086431744 00000100:00100000:0.0:1788642296.387919:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 123 00000100:00100000:0.0:1788642296.387934:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:10573:x1875527086431744:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788642296.388070:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:10573:x1875527086431744:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 139us (9116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642296.388078:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 123 00000100:00100000:3.0:1788642296.392513:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642296.393525:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086431872 00000100:00100000:0.0:1788642296.393535:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086431872 00000100:00100000:0.0:1788642296.393602:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:0.0:1788642296.393612:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:10573:x1875527086431872:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788642296.393631:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642296.393650:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9937 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.393715:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000517881b2/0x4ae1ee156666da04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9930 expref: 11 pid: 9442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.393725:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642296.393730:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642296.393744:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9937 expref: 11 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.393784:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000517881b2/0x4ae1ee156666da04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9930 expref: 11 pid: 9442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.393797:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000517881b2/0x4ae1ee156666da04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9930 expref: 11 pid: 9442 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642296.393813:0:6709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeffac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1875527107416448:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642296.393924:0:6709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc6386d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788642296.407217:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.407518:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086432000 00000100:00100000:2.0:1788642296.407530:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086432000 00010000:00010000:2.0:1788642296.407578:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000517881b2/0x4ae1ee156666da04 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9930 expref: 12 pid: 9442 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642296.407628:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:2.0:1788642296.407638:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddde4e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+12:2359:x1875527086432000:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642296.407658:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642296.407697:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000517881b2/0x4ae1ee156666da04 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9930 expref: 12 pid: 9442 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.407713:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000517881b2/0x4ae1ee156666da04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9930 expref: 12 pid: 9442 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.407750:0:5845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642296.407755:0:5845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642296.407764:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9937 expref: 12 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.407776:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9937 expref: 12 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.407821:0:5845:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9937 expref: 12 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642296.407856:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb59aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5845:1875527107416576:192.168.202.49@tcp:105: 00000100:00100000:2.0:1788642296.407952:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc7038000 going to sleep for 11 seconds 00010000:00010000:0.0:1788642296.409633:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000517881b2/0x4ae1ee156666da04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9930 expref: 12 pid: 9442 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642296.409658:0:6709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeffac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1875527107416448:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642296.409701:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9937 expref: 11 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.409714:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5d000, rc 0) 00000100:00100000:0.0:1788642296.409921:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+11:10573:x1875527086431872:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 16308us (17417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642296.409930:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:2.0:1788642296.424297:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb59aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5845:1875527107416576:192.168.202.49@tcp:105: 00010000:00010000:2.0:1788642296.424586:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642296.424647:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddde4e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:2359:x1875527086432000:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 17008us (17439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.424659:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:3.0:1788642296.427163:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.427251:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086432128 00000100:00100000:2.0:1788642296.427262:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086432128 00002000:00100000:2.0:1788642296.427342:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8dddfaa6ce00 x1875527086432128/t0(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:497/0 lens 504/0 e 0 to 0 dl 1788642307 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788642296.427354:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddfaa6ce00 with x1875527086432128 ext(0->12) 00002000:00010000:2.0:1788642296.427360:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddfaa6ce00 00000100:00100000:2.0:1788642296.427391:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:2.0:1788642296.427401:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:2360:x1875527086432128:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788642296.441167:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+12:2360:x1875527086432128:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 Request processed in 13753us (14004us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788642296.441184:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00002000:00100000:2.0:1788642296.441199:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8dddfaa6ce00 x1875527086432128/t4294967308(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:497/0 lens 504/448 e 0 to 0 dl 1788642307 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788642296.441211:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddfaa6ce00 with x1875527086432128 ext(0->12) 00002000:00010000:2.0:1788642296.441218:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddfaa6ce00 00000100:00100000:3.0:1788642296.447942:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642296.453818:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086432256 00000100:00100000:1.0:1788642296.453834:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086432256 00000100:00100000:2.0:1788642296.458592:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 124 00000100:00100000:2.0:1788642296.458606:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:10573:x1875527086432256:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788642296.475142:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642296.475199:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642296.475933:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086432640 00000100:00100000:3.0:1788642296.475944:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086432640 00000100:00100000:2.0:1788642296.475951:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086432384 00000100:00100000:2.0:1788642296.475958:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086432384 00000100:00080000:3.0:1788642296.475975:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642296.476019:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 288 00000100:00100000:3.0:1788642296.476020:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 142 00000100:00100000:2.0:1788642296.476036:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086432384:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642296.476037:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086432640:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642296.476135:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086432384:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 105us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.476144:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 288 00000100:00100000:2.0:1788642296.480564:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086432640:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 4521us (5354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.480580:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 142 00000100:00100000:1.0:1788642296.523648:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642296.523803:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086432512 00000100:00100000:3.0:1788642296.523813:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086432512 00000100:00100000:3.0:1788642296.523865:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:3.0:1788642296.523874:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086432512:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642296.523952:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086432512:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 78us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642296.523959:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 79 00000001:00080000:0.0:1788642296.557833:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967389 is committed 00000001:00080000:0.0:1788642296.557855:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788642296.557873:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788642296.557907:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dddfa6d56c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788642296.557913:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ddde0ac1b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dddfa6d5600 00000020:00080000:0.0:1788642296.557916:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ddde0ac1d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dddfaa10c00 00000004:00080000:0.0:1788642296.557939:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788642296.557951:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ddcc7038e40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788642296.557954:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dddd0b55f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dddd0aad000 00000020:00080000:0.0:1788642296.557956:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dddd0b55a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dddfaec8400 00000004:00080000:0.0:1788642296.557977:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788642296.558065:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788642296.558297:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788642296.558828:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107416960:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788642296.558891:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642296.558981:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107416960 00000100:00100000:3.0:1788642296.558989:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107416960 00000100:00100000:3.0:1788642296.559029:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788642296.559037:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1875527107416960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788642296.559062:0:6711:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1788642296.559094:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c83f7, atime: 0x6a9c83f7, ctime: 0x6a9c83f7, blocks: 0x1 00010000:00010000:3.0:1788642296.559122:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666da12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.559138:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1788642296.559142:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642296.559150:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666da12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.559165:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666da12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.559176:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666da12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.559183:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666da12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.559201:0:6711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788642296.560545:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107416704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788642296.560601:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642296.560673:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642296.560689:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107416832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788642296.560710:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642296.560749:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107416704 00000100:00100000:0.0:1788642296.560755:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107416704 00000100:00100000:0.0:1788642296.560793:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107416832 00000100:00100000:0.0:1788642296.560796:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107416832 00000100:00100000:0.0:1788642296.560818:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788642296.560824:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1875527107416704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788642296.560855:0:6712:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788642296.560876:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.560898:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005598a8a5/0x4ae1ee156666d7d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9896 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.560906:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1788642296.560910:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788642296.560914:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.560939:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005598a8a5/0x4ae1ee156666d7d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9896 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.560952:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005598a8a5/0x4ae1ee156666d7d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9896 expref: 11 pid: 6711 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642296.560964:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddefface00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6712:1875527107417088:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642296.561018:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3e36a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788642296.561973:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1875527107416960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2931us (3076us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788642296.561983:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788642296.562016:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788642296.562024:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3319:x1875527107416832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788642296.562182:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788642296.562186:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788642296 00002000:00010000:3.0:1788642296.562188:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788642296.562190:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788642296 -> 1788642296 00002000:00010000:3.0:1788642296.562193:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788642296.562226:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3319:x1875527107416832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 204us (1514us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788642296.562232:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1788642296.562253:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:0.0:1788642296.562544:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dddc5dcd880/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788642296.562552:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107416960:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788642296.562736:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dddc5dcdf80/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788642296.562743:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107416832:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788642296.564862:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666da12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.564887:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031400 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:3.0:1788642296.564894:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666da12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.564906:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666da12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.564932:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666da12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.564940:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009fe2ef3/0x4ae1ee156666da12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.564997:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642296.565000:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642296.565002:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788642296.565025:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788642296.565522:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:10573:x1875527086432256:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 Request processed in 106910us (117582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.565532:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 124 00000100:00100000:0.0:1788642296.567232:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddefface00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6712:1875527107417088:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642296.567259:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642296.569146:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.569644:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086432768 00000100:00100000:2.0:1788642296.569655:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086432768 00000100:00100000:2.0:1788642296.569886:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:2.0:1788642296.569899:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+12:2361:x1875527086432768:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788642296.582981:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642296.583475:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086432896 00000100:00100000:3.0:1788642296.583485:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086432896 00010000:00010000:3.0:1788642296.583524:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005598a8a5/0x4ae1ee156666d7d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9896 expref: 13 pid: 6711 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642296.583565:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 54 00000100:00100000:3.0:1788642296.583575:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:2359:x1875527086432896:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642296.583590:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642296.583596:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005598a8a5/0x4ae1ee156666d7d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9896 expref: 13 pid: 6711 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.583610:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005598a8a5/0x4ae1ee156666d7d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9896 expref: 13 pid: 6711 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.583637:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005598a8a5/0x4ae1ee156666d7d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9896 expref: 13 pid: 6711 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.583653:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788642296.583658:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788642296.583664:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.583697:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.583740:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642296.583792:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+12:2359:x1875527086432896:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 219us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642296.583800:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 54 00010000:00010000:1.0:1788642296.584320:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.584331:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.584351:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.584359:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.584382:0:6712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788642296.584937:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3319:x1875527107416704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24111us (24333us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788642296.584945:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1788642296.585011:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dddc7395880/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788642296.585018:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107416704:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788642296.586187:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642296.586201:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.586215:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5da00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:3.0:1788642296.586221:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.586232:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.586253:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.586275:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cad1418f/0x4ae1ee156666da19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.586297:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642296.586320:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642296.586322:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788642296.627486:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1788642296.627511:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788642296.627523:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1788642296.628412:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086432768:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 Request processed in 58508us (59266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.628426:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:1.0:1788642296.633542:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642296.633748:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086433152 00000100:00100000:0.0:1788642296.633760:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086433152 00000100:00100000:0.0:1788642296.633895:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 125 00000100:00100000:0.0:1788642296.633906:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:10573:x1875527086433152:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788642296.633970:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642296.633998:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666d9fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9929 expref: 15 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.634018:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc98d9a00) 00010000:00010000:0.0:1788642296.634023:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642296.634054:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666da20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.634068:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666da20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.634078:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666da20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788642296.635217:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003eeae487 reply state 00000000db76f7db transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666da20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642296.635231:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788642296.635572:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:10573:x1875527086433152:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 1664us (2038us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788642296.635580:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 125 00010000:00010000:2.0:1788642296.643215:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666da20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.643233:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666da20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.643251:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666da20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.643271:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642296.643276:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666da20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.643285:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666da20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.643308:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc98d9a00) 00010000:00010000:2.0:1788642296.643312:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642296.643317:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666da20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.643323:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666da20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642296.643605:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642296.644057:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086433280 00000100:00100000:0.0:1788642296.644068:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086433280 00000100:00100000:0.0:1788642296.644251:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:0.0:1788642296.644273:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086433280:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788642296.644485:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788642296.644489:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788642296 -> 1788642295 00002000:00010000:0.0:1788642296.644492:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788642295 00002000:00010000:0.0:1788642296.644502:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788642296 -> 1788642295 00002000:00010000:0.0:1788642296.644504:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788642296.644561:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086433280:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 295us (961us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788642296.644569:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:3.0:1788642296.652812:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.653408:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086433536 00000100:00100000:2.0:1788642296.653419:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086433536 00000100:00100000:2.0:1788642296.653492:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 126 00000100:00100000:2.0:1788642296.653502:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:10573:x1875527086433536:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788642296.653574:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.653592:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a991b expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.653602:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.653651:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a991b expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.653675:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a991b expref: 15 pid: 5863 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642296.653691:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb59aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107417216:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788642296.653921:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd91fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642296.660966:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642296.661056:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086433664 00000100:00100000:3.0:1788642296.661066:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086433664 00010000:00010000:3.0:1788642296.661145:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a991b expref: 16 pid: 5863 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642296.661183:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:3.0:1788642296.661193:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:2360:x1875527086433664:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642296.661207:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642296.661214:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a991b expref: 16 pid: 5863 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.661226:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a991b expref: 16 pid: 5863 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.661250:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc98d9a00) 00010000:00010000:3.0:1788642296.661427:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.661439:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.661447:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.661481:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642296.661531:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:2360:x1875527086433664:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 339us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642296.661538:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 55 00010000:00010000:2.0:1788642296.661971:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666d9e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a991b expref: 15 pid: 5863 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642296.661989:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb59aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107417216:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642296.662009:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.662019:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.662024:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.662054:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.662061:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.662068:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.662081:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642296.662085:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.662093:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.662152:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc98d9a00) 00010000:00010000:2.0:1788642296.662155:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788642296.662159:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.662165:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642296.662210:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:10573:x1875527086433536:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 Request processed in 8709us (9407us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788642296.662218:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 126 00000100:00100000:1.0:1788642296.666069:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642296.666204:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086433792 00000100:00100000:0.0:1788642296.666214:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086433792 00000100:00100000:0.0:1788642296.666281:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:0.0:1788642296.666291:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086433792:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788642296.666612:0:6712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.666635:0:6712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9937 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.666644:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788642296.666649:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788642296.666654:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.666701:0:6712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9937 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.666725:0:6712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9937 expref: 7 pid: 6709 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642296.666742:0:6712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddefface00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6712:1875527107417344:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642296.666847:0:6712:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3e36000 going to sleep for 11 seconds 00000100:00100000:1.0:1788642296.671972:0:6712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddefface00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6712:1875527107417344:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642296.672008:0:6712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642296.672632:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.672718:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086433920 00000100:00100000:2.0:1788642296.672726:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086433920 00010000:00010000:2.0:1788642296.672768:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9937 expref: 8 pid: 6709 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642296.672806:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00100000:2.0:1788642296.672816:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2359:x1875527086433920:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642296.672832:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642296.672858:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9937 expref: 8 pid: 6709 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.672898:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9937 expref: 8 pid: 6709 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.672923:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026c1a7e3/0x4ae1ee156666da0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9937 expref: 8 pid: 6709 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.672942:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788642296.672946:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788642296.672952:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.672962:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.672994:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642296.673051:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086433920:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 236us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.673059:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 56 00010000:00010000:1.0:1788642296.673272:0:6712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.673282:0:6712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.673314:0:6712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.673323:0:6712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.673330:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.673336:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5dc00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642296.673340:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.673349:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.673361:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.673383:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0012acd/0x4ae1ee156666da2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642296.673445:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086433792:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 Request processed in 7155us (7384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642296.673453:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:1.0:1788642296.687820:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.687916:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086434176 00000100:00100000:2.0:1788642296.687936:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086434176 00000100:00100000:2.0:1788642296.688005:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 127 00000100:00100000:2.0:1788642296.688016:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:10573:x1875527086434176:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788642296.688137:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.688157:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.688187:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.688649:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.688672:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9922 expref: 15 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.688679:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.688715:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9922 expref: 15 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.688739:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9922 expref: 15 pid: 9441 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642296.688754:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5295c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107417472:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642296.688846:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788642296.692557:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642296.692918:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086434304 00000100:00100000:1.0:1788642296.692933:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086434304 00010000:00010000:1.0:1788642296.692977:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9ef lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9922 expref: 16 pid: 9441 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642296.693026:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:1.0:1788642296.693036:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddefface00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:2359:x1875527086434304:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642296.693050:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642296.693057:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9ef lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9922 expref: 16 pid: 9441 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.693070:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9922 expref: 16 pid: 9441 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642296.693075:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5295c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107417472:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642296.693091:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666d9ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9922 expref: 16 pid: 9441 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.693129:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.693134:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc98d9a00) 00010000:00010000:1.0:1788642296.693154:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.693164:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.693174:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642296.698348:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788642296.698410:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.698426:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642296.698442:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddefface00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:2359:x1875527086434304:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 5403us (5892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642296.698468:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 57 00000001:00080000:1.0:1788642296.698627:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788642296.698785:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788642296.698829:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788642296.698924:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1875527107417600:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788642296.698977:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642296.699009:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5000 going to sleep for 11 seconds 00000100:00100000:0.0:1788642296.700208:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107417600 00000100:00100000:0.0:1788642296.700221:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107417600 00000100:00100000:0.0:1788642296.700283:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788642296.700301:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5861:x1875527107417600:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788642296.700404:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5861:x1875527107417600:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642296.700411:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788642296.700444:0:5861:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1788642296.700450:0:5861:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1788642296.700469:0:5861:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dddc5dcdf80, transno 4294967309 00000100:00100000:1.0:1788642296.700494:0:5861:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8dddc7395880 x1875527107416704/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788642312 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642296.700508:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1875527107417600:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788642296.701016:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788642296.701087:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1875527107417728:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788642296.701178:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642296.701215:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788642296.701260:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107417728 00000100:00100000:0.0:1788642296.701266:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107417728 00000100:00100000:0.0:1788642296.701307:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788642296.701315:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5861:x1875527107417728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788642296.701488:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5861:x1875527107417728:12345-0@lo:1000:mdt00_000.0 Request processed in 173us (310us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788642296.701496:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788642296.701739:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1875527107417728:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788642296.701772:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701781:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701788:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701794:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642296.701799:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701806:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701823:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc98d9a00) 00010000:00010000:1.0:1788642296.701826:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788642296.701831:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701837:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666da3c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701875:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d97f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701895:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d97f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701900:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d97f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701912:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1e00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642296.701915:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d97f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701920:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d97f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701928:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:1.0:1788642296.701931:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788642296.701937:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d986 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9906 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701949:0:5861:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d986 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9906 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701958:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d986 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9906 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.701987:0:5861:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d986 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9906 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642296.701998:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107417856:192.168.202.49@tcp:105: 00000100:00100000:1.0:1788642296.702069:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788642296.707438:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107417856:192.168.202.49@tcp:105: 00010000:00010000:1.0:1788642296.707481:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d97f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707514:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666d97f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707550:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666da43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707567:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666da43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707579:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666da43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707591:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666da43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707597:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666da43 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707602:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666da43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707607:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642296.707610:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666da43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707616:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666da43 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707628:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:1.0:1788642296.707631:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642296.707635:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666da43 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707646:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666da43 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707655:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707672:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707678:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707682:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642296.707685:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707691:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707699:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:1.0:1788642296.707701:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788642296.707704:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.707709:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666da35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642296.707983:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:10573:x1875527086434176:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 19968us (20178us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788642296.707993:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 127 00000020:00080000:1.0:1788642296.708004:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788642296.708995:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788642296.709002:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788642296.710273:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788642296.710285:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788642296.711889:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642296.712350:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086434432 00000100:00100000:1.0:1788642296.712361:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086434432 00000100:00100000:1.0:1788642296.712414:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:1.0:1788642296.712423:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:10572:x1875527086434432:12345-192.168.202.49@tcp:49:lfs.0 00000100:00100000:1.0:1788642296.712554:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:10572:x1875527086434432:12345-192.168.202.49@tcp:49:lfs.0 Request processed in 132us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642296.712562:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:0.0:1788642296.715744:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642296.715817:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086434688 00000100:00100000:1.0:1788642296.715827:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086434688 00000100:00100000:1.0:1788642296.715890:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:1.0:1788642296.715900:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddddbdcb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:10573:x1875527086434688:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788642296.716657:0:5865:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788642296.716786:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788642296.716830:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.716846:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.716858:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.716867:0:5865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da4a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.716873:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da4a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.716879:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.716911:0:5865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788642296.717009:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddddbdcb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:10573:x1875527086434688:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 1108us (1273us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788642296.717016:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 32 00000020:00080000:1.0:1788642296.717021:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788642296.718727:0:7657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642296.718739:0:7657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.718749:0:7657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50800 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:3.0:1788642296.718753:0:7657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.718763:0:7657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.718790:0:7657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:3.0:1788642296.718793:0:7657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788642296.718798:0:7657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da4a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.718805:0:7657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642296.718833:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642296.718835:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642296.718837:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642296.726347:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642296.726489:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086434944 00000100:00100000:3.0:1788642296.726499:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086434944 00000100:00100000:3.0:1788642296.726566:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 128 00000100:00100000:3.0:1788642296.726577:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:10572:x1875527086434944:12345-192.168.202.49@tcp:58:lfs.0 00000040:00080000:3.0:1788642296.726909:0:9441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788642296.727016:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:10572:x1875527086434944:12345-192.168.202.49@tcp:58:lfs.0 Request processed in 440us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642296.727040:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 128 00010000:00010000:3.0:1788642296.763111:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642296.786180:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642296.786452:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086435072 00000100:00100000:1.0:1788642296.786463:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086435072 00000100:00100000:1.0:1788642296.786528:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 129 00000100:00100000:1.0:1788642296.786538:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:10575:x1875527086435072:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642296.786559:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642296.786582:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666da51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a993e expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.786644:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666da58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.786669:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666da58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.786681:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666da58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.786696:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.786703:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.786709:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.787136:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666da66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.787149:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ff expref: 21 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.787157:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666da66 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.787191:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ff expref: 21 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.787205:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ff expref: 21 pid: 5861 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642296.787218:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107417984:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642296.788012:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfa6d5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642296.792854:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642296.793007:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086435328 00000100:00100000:3.0:1788642296.793018:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086435328 00000100:00100000:3.0:1788642296.793085:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:3.0:1788642296.793096:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:5612:x1875527086435328:12345-192.168.202.49@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788642296.793397:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:5612:x1875527086435328:12345-192.168.202.49@tcp:35:ldlm_bl.0 Request processed in 302us (554us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788642296.793405:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:1.0:1788642296.794633:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107417984:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642296.794674:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666da66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642296.797308:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642296.797396:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086435456 00000100:00100000:2.0:1788642296.797406:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086435456 00010000:00010000:2.0:1788642296.797443:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ff expref: 23 pid: 5861 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642296.797493:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:2.0:1788642296.797501:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:2361:x1875527086435456:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642296.797516:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642296.797522:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ff expref: 23 pid: 5861 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.797535:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ff expref: 23 pid: 5861 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.797557:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666d971 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a98ff expref: 23 pid: 5861 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.797573:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:2.0:1788642296.797579:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666da66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.797588:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666da66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.797596:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666da66 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642296.797640:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642296.797698:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:2361:x1875527086435456:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 197us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642296.797705:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 58 00010000:00010000:1.0:1788642296.797817:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666da66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.797826:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666da66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642296.797868:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788642296.797878:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642296.797900:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666da66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.797913:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666da66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.797923:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666da58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.797929:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666da58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.797936:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666da58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.797943:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642296.797946:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666da58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.797954:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666da58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.797963:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:1.0:1788642296.797966:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642296.797969:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666da58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.797975:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666da58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.797986:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.798002:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.798008:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.798014:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642296.798016:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.798022:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.798030:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dddc365fa00) 00010000:00010000:1.0:1788642296.798032:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642296.798035:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.798041:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666da5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.798077:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666da51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a993e expref: 22 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.798090:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666da66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a993e expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642296.798138:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:1.0:1788642296.798141:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642296.798149:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50c00, rc 0) 00000100:00100000:1.0:1788642296.798173:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:10575:x1875527086435072:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 11636us (12003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642296.798180:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 129 00000100:00100000:3.0:1788642297.535442:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107418112:0@lo:400:kworker.0 00000100:00100000:3.0:1788642297.535514:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642297.535566:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788642297.535572:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107418496:0@lo:400:kworker.0 00000100:00100000:3.0:1788642297.535599:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642297.535648:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107418240:0@lo:400:kworker.0 00000100:00100000:3.0:1788642297.535674:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642297.535705:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642297.535711:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107418368:0@lo:400:kworker.0 00000100:00100000:3.0:1788642297.535734:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642297.535764:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107418112 00000100:00100000:3.0:1788642297.535772:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107418112 00000100:00100000:3.0:1788642297.535822:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788642297.535831:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107418112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642297.535884:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107418112:12345-0@lo:400:kworker.0 Request processed in 54us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642297.535904:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788642297.535937:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107418496 00000100:00100000:3.0:1788642297.535941:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107418496 00000100:00100000:3.0:1788642297.535975:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107418240 00000100:00100000:3.0:1788642297.535978:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107418240 00000100:00100000:3.0:1788642297.535988:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107418368 00000100:00100000:3.0:1788642297.535990:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107418368 00000100:00100000:3.0:1788642297.536005:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788642297.536010:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107418496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642297.536042:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107418496:12345-0@lo:400:kworker.0 Request processed in 31us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642297.536049:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788642297.536061:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788642297.536066:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107418240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642297.536095:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107418240:12345-0@lo:400:kworker.0 Request processed in 30us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642297.536123:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788642297.536134:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788642297.536140:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107418368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642297.536167:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107418368:12345-0@lo:400:kworker.0 Request processed in 28us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642297.536173:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1788642297.536193:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642297.536222:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107418368:0@lo:400:kworker.0 00000100:00100000:3.0:1788642297.536248:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107418240:0@lo:400:kworker.0 00000100:00100000:3.0:1788642297.536288:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107418496:0@lo:400:kworker.0 00000100:00100000:3.0:1788642297.536297:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107418112:0@lo:400:kworker.0 00000040:00080000:3.0:1788642297.723433:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788642297.723444:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788642297.723499:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788642297.723509:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788642297.723671:0:11714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5295c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11714:1875527107418624:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788642297.723790:0:11714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642297.743156:0:11714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5295c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11714:1875527107418624:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788642297.746685:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642297.746786:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086435584 00000100:00100000:3.0:1788642297.746798:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086435584 00000100:00100000:3.0:1788642297.746971:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 130 00000100:00100000:3.0:1788642297.746982:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:10586:x1875527086435584:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788642297.747017:0:9441:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788642297.747151:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:10586:x1875527086435584:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 171us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642297.747159:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 130 00000100:00100000:0.0:1788642297.751799:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642297.751957:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086435840 00000100:00100000:2.0:1788642297.751967:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086435840 00000100:00100000:2.0:1788642297.752059:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 131 00000100:00100000:2.0:1788642297.752070:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:10586:x1875527086435840:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788642297.752090:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642297.752139:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666da6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9945 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642297.752268:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0c00/0x4ae1ee156666da74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642297.752283:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0c00/0x4ae1ee156666da74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642297.752297:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0c00/0x4ae1ee156666da74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642297.752309:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788642297.752668:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666da6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9945 expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642297.752688:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0c00/0x4ae1ee156666da74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9945 expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642297.752703:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:2.0:1788642297.752706:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788642297.752709:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0c00, rc 0) 00000100:00100000:2.0:1788642297.752769:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:10586:x1875527086435840:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 700us (981us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788642297.752776:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 131 00000100:00100000:2.0:1788642297.774553:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642297.774672:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642297.774717:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086436224 00000100:00100000:2.0:1788642297.774727:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086436224 00000100:00100000:2.0:1788642297.774800:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:2.0:1788642297.774810:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:2362:x1875527086436224:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642297.774841:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642297.774867:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0c00/0x4ae1ee156666da74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9945 expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642297.774890:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:2.0:1788642297.774896:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642297.774954:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb599c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:2362:x1875527086436224:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 145us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642297.774961:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:3.0:1788642297.778497:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086436096 00000100:00100000:3.0:1788642297.778519:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086436096 00000100:00100000:3.0:1788642297.778632:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 132 00000100:00100000:3.0:1788642297.778644:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:10586:x1875527086436096:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788642297.778753:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666da82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642297.778777:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666da82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642297.778808:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666da82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642297.779333:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666da82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642297.779343:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666da82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642297.779350:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666da82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642297.779357:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642297.779361:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666da82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642297.779369:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666da82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642297.779382:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642297.779385:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788642297.779390:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666da82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642297.781523:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666da82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642297.781792:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:10586:x1875527086436096:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 3144us (7246us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788642297.781804:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 132 00000040:00080000:1.0:1788642297.783813:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788642297.783821:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788642297.785412:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788642297.785427:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788642297.786502:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642297.793582:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642297.793676:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086436480 00000100:00100000:3.0:1788642297.793688:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086436480 00000100:00100000:3.0:1788642297.793753:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:3.0:1788642297.793763:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:10586:x1875527086436480:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788642297.794141:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:10586:x1875527086436480:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 337us (529us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788642297.794149:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 34 00000040:00080000:2.0:1788642297.837058:0:12133:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642297.837068:0:12133:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788642297.838050:0:12133:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788642297.839013:0:12133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788642298.045870:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107418752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642298.045962:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642298.046075:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107418752 00000100:00100000:1.0:1788642298.046085:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107418752 00000100:00100000:1.0:1788642298.046183:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788642298.046194:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875527107418752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642298.046253:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642298.046302:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875527107418752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642298.046309:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788642298.046572:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788642298.046622:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107418752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642298.135819:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642298.141061:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086436736 00000100:00100000:3.0:1788642298.141080:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086436736 00000100:00100000:3.0:1788642298.141163:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 133 00000100:00100000:3.0:1788642298.141173:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:10599:x1875527086436736:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642298.141207:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642298.141234:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666da89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a994c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.141325:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666da90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.141339:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666da90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.141351:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666da90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642298.141362:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788642298.141476:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666da89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a994c expref: 27 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.141506:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666da90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a994c expref: 26 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.141515:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642298.141518:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788642298.141521:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031200, rc 0) 00000100:00100000:3.0:1788642298.141576:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:10599:x1875527086436736:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 405us (5770us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788642298.141583:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 133 00000100:00080000:3.0:1788642298.141614:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642298.150873:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642298.150954:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086436864 00000100:00100000:3.0:1788642298.150964:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086436864 00000100:00100000:3.0:1788642298.151028:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 134 00000100:00100000:3.0:1788642298.151039:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:10599:x1875527086436864:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:3.0:1788642298.151154:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666da9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.151172:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666da9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.151185:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666da9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.151233:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666da9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.151240:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666da9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.151266:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666da9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.151271:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642298.151276:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666da9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.151284:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666da9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.151297:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642298.151301:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788642298.151305:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666da9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642298.151312:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666da9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642298.151570:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:10599:x1875527086436864:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 530us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642298.151577:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 134 00000100:00100000:3.0:1788642298.247028:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642298.247386:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086436992 00000100:00100000:0.0:1788642298.247396:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086436992 00000100:00100000:0.0:1788642298.247477:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:0.0:1788642298.247488:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2360:x1875527086436992:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:0.0:1788642298.247505:0:9442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642298.247525:0:9442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddbe9801/0x4ae1ee156666daa5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9953 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788642298.247553:0:9442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c83f7, atime: 0x6a9c83f7, ctime: 0x6a9c83f7, blocks: 0xb 00010000:00010000:0.0:1788642298.247573:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1788642298.247577:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642298.247600:0:9442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddbe9801/0x4ae1ee156666daa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9953 expref: 7 pid: 9442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642298.247622:0:9442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ddbe9801/0x4ae1ee156666daa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9953 expref: 7 pid: 9442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642298.247635:0:9442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5d400, rc 0) 00000100:00100000:0.0:1788642298.247696:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086436992:12345-192.168.202.49@tcp:101:cat.0 Request processed in 209us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642298.247702:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00080000:3.0:1788642298.248580:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788642298.254503:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642298.254610:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086437120 00000100:00100000:3.0:1788642298.254621:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086437120 00002000:00100000:3.0:1788642298.254675:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8dddc2f9b480 x1875527086437120/t0(0) o3->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:499/0 lens 488/0 e 0 to 0 dl 1788642309 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788642298.254687:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddc2f9b480 with x1875527086437120 ext(0->4095) 00002000:00010000:3.0:1788642298.254692:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddc2f9b480 00000100:00100000:3.0:1788642298.254740:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:3.0:1788642298.254750:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2361:x1875527086437120:12345-192.168.202.49@tcp:3:cat.0 00000100:00100000:3.0:1788642298.255008:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2361:x1875527086437120:12345-192.168.202.49@tcp:3:cat.0 Request processed in 259us (519us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788642298.255016:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00002000:00100000:3.0:1788642298.255023:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8dddc2f9b480 x1875527086437120/t0(0) o3->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:499/0 lens 488/4536 e 0 to 0 dl 1788642309 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788642298.255031:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddc2f9b480 with x1875527086437120 ext(0->4095) 00002000:00010000:3.0:1788642298.255035:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddc2f9b480 00000001:00080000:2.0:1788642298.658655:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788642298.658680:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788642298.658689:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:3.0:1788642298.810471:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642299.067806:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107418880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642299.067907:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642299.068139:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107418880 00000100:00100000:3.0:1788642299.068151:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107418880 00000100:00100000:3.0:1788642299.068238:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788642299.068253:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107418880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642299.068319:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642299.068383:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107418880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642299.068392:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788642299.070664:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788642299.070728:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788642299.070756:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788642299.070797:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dddc5dcd880, transno 4294967304 00000100:00100000:0.0:1788642299.070837:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107418880:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788642299.835299:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642300.858415:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642301.598618:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642301.598668:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642301.598731:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642301.598762:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642301.598787:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642301.598824:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086437760 00000100:00100000:2.0:1788642301.598834:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086437760 00000100:00100000:2.0:1788642301.598916:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086437376 00000100:00100000:2.0:1788642301.598919:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086437376 00000100:00100000:2.0:1788642301.598942:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 146 00000100:00100000:2.0:1788642301.598952:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086437760:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642301.599030:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086437760:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 79us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642301.599037:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 146 00000100:00100000:2.0:1788642301.599054:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 147 00000100:00100000:2.0:1788642301.599073:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:2359:x1875527086437376:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642301.599126:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:2359:x1875527086437376:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 66us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642301.599140:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 147 00000100:00100000:1.0:1788642301.599344:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086437504 00000100:00100000:1.0:1788642301.599349:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086437504 00000100:00100000:1.0:1788642301.599379:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086437632 00000100:00100000:1.0:1788642301.599382:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086437632 00000100:00100000:1.0:1788642301.599403:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:1.0:1788642301.599411:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086437504:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642301.599454:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086437504:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 45us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642301.599461:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:1.0:1788642301.599474:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:1.0:1788642301.599488:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086437632:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642301.599517:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086437632:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 31us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642301.599523:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:0.0:1788642301.599685:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086437248 00000100:00100000:0.0:1788642301.599691:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086437248 00000100:00100000:0.0:1788642301.599729:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 290 00000100:00100000:0.0:1788642301.599737:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086437248:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642301.599765:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086437248:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 30us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642301.599771:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 290 00000100:00080000:0.0:1788642301.599804:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642301.599808:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788642301.599812:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788642301.721813:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1788642301.721835:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788642301.750243:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000001:00080000:0.0:1788642301.750260:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000020:00080000:0.0:1788642301.750274:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dddfa6d5000 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788642301.750280:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ddde0ac1c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dddfa6d53c0 00000020:00080000:0.0:1788642301.750283:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ddde0ac1200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ddcc52dd000 00000020:00080000:0.0:1788642301.750300:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1788642301.750307:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:0.0:1788642301.750320:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788642301.750378:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788642301.750724:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788642301.886454:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642302.658738:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107419008:0@lo:400:kworker.0 00000100:00100000:3.0:1788642302.658807:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642302.658898:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107419136:0@lo:400:kworker.0 00000100:00100000:0.0:1788642302.658999:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107419008 00000100:00100000:0.0:1788642302.659007:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107419008 00000100:00100000:0.0:1788642302.659051:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788642302.659060:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3320:x1875527107419008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642302.659131:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3320:x1875527107419008:12345-0@lo:400:kworker.0 Request processed in 72us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642302.659144:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788642302.659259:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642302.659320:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107419008:0@lo:400:kworker.0 00000100:00100000:3.0:1788642302.659357:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107419264:0@lo:400:kworker.0 00000100:00100000:3.0:1788642302.659405:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642302.659561:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107419136 00000100:00100000:0.0:1788642302.659565:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107419136 00000100:00100000:0.0:1788642302.659593:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107419264 00000100:00100000:0.0:1788642302.659596:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107419264 00000100:00100000:0.0:1788642302.659620:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788642302.659626:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107419136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642302.659660:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107419136:12345-0@lo:400:kworker.0 Request processed in 35us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642302.659666:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788642302.659677:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788642302.659683:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107419264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642302.659710:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107419264:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642302.659715:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1788642302.659732:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642302.659785:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107419136:0@lo:400:kworker.0 00000100:00100000:3.0:1788642302.659806:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107419264:0@lo:400:kworker.0 00000100:00100000:0.0:1788642302.659857:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107419392:0@lo:400:kworker.0 00000100:00100000:0.0:1788642302.659887:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642302.663933:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107419392 00000100:00100000:1.0:1788642302.663949:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107419392 00000100:00100000:1.0:1788642302.664177:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788642302.664188:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107419392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642302.664409:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1875527107419520:0@lo:400:kworker.0 00000100:00100000:3.0:1788642302.664463:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642302.664511:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107419520 00000100:00100000:3.0:1788642302.664515:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107419520 00000100:00100000:3.0:1788642302.664560:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788642302.664567:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875527107419520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642302.664599:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875527107419520:12345-0@lo:400:kworker.0 Request processed in 33us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642302.664606:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788642302.664642:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1875527107419520:0@lo:400:kworker.0 00000100:00100000:3.0:1788642302.664703:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107419648:0@lo:400:kworker.0 00000100:00100000:3.0:1788642302.664726:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642302.664755:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107419648 00000100:00100000:3.0:1788642302.664758:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107419648 00000100:00100000:3.0:1788642302.664780:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788642302.664786:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107419648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642302.664816:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107419648:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642302.664822:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788642302.664856:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788642302.664861:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dddc7395880, transno 4294967310 00000004:00080000:3.0:1788642302.664870:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788642302.664887:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107419648:0@lo:400:kworker.0 00000100:00080000:3.0:1788642302.666775:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788642302.666785:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788642302.666788:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642302.669166:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107419392:12345-0@lo:400:kworker.0 Request processed in 4971us (9269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642302.669182:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788642302.669708:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107419392:0@lo:400:kworker.0 00000040:00080000:2.0:1788642302.906682:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642302.906694:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642302.906759:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788642302.906768:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788642302.913816:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642303.162954:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107419776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788642303.163043:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642303.164710:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107419776 00000100:00100000:1.0:1788642303.164723:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107419776 00000100:00100000:1.0:1788642303.164803:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788642303.164812:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107419776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642303.164855:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642303.164937:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107419776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642303.164944:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788642303.165456:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107419776:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788642303.931776:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642304.202537:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788642304.202567:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107419904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642304.202666:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642304.202761:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107419904 00000100:00100000:3.0:1788642304.202769:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107419904 00000100:00100000:3.0:1788642304.202832:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788642304.202842:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107419904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642304.202882:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642304.202929:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107419904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642304.202937:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788642304.202960:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642304.203010:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107419904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788642304.956263:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642305.289310:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642305.289429:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086437888 00000100:00100000:2.0:1788642305.289440:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086437888 00000100:00100000:2.0:1788642305.289525:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 135 00000100:00100000:2.0:1788642305.289538:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:10251:x1875527086437888:12345-192.168.202.49@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788642305.289665:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:10251:x1875527086437888:12345-192.168.202.49@tcp:60:lhsmtool_posix.0 Request processed in 131us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642305.289674:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 135 00000100:00080000:3.0:1788642305.289813:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642305.303045:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642305.310542:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086438144 00000100:00100000:1.0:1788642305.310559:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086438144 00000100:00100000:1.0:1788642305.310654:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:1.0:1788642305.310667:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:10251:x1875527086438144:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788642305.314566:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:10251:x1875527086438144:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 3890us (11522us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788642305.314582:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:1.0:1788642305.880230:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642305.880387:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086438272 00000100:00100000:3.0:1788642305.880408:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086438272 00000100:00100000:3.0:1788642305.880492:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 136 00000100:00100000:3.0:1788642305.880502:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:11051:x1875527086438272:12345-192.168.202.49@tcp:101:lsof.0 00010000:00010000:3.0:1788642305.880521:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788642305.881865:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788642305.881911:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a995a expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642305.881993:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666dab3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642305.882011:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666dab3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642305.882027:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666dab3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642305.883029:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788642305.883036:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642305.883087:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666dab3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642305.883137:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a995a expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642305.883166:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666dab3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a995a expref: 6 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642305.883177:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:3.0:1788642305.883181:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788642305.883185:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031600, rc 0) 00000100:00100000:3.0:1788642305.883286:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:11051:x1875527086438272:12345-192.168.202.49@tcp:101:lsof.0 Request processed in 2784us (3072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642305.883296:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 136 00010000:00010000:3.0:1788642305.978352:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642306.716274:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642306.716370:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642306.716467:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642306.716491:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642306.716523:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642306.716562:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086438528 00000100:00100000:0.0:1788642306.716576:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086438528 00000100:00100000:0.0:1788642306.716629:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086438912 00000100:00100000:0.0:1788642306.716631:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086438912 00000100:00100000:0.0:1788642306.716650:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 151 00000100:00100000:0.0:1788642306.716659:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:2362:x1875527086438528:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642306.716743:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:2362:x1875527086438528:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 85us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642306.716751:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 151 00000100:00100000:0.0:1788642306.716771:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 152 00000100:00100000:0.0:1788642306.716777:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2361:x1875527086438912:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642306.716801:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2361:x1875527086438912:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 23us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642306.716807:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 152 00000100:00100000:0.0:1788642306.716826:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086438656 00000100:00100000:0.0:1788642306.716830:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086438656 00000100:00100000:0.0:1788642306.716865:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086438784 00000100:00100000:0.0:1788642306.716867:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086438784 00000100:00100000:0.0:1788642306.716889:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:0.0:1788642306.716896:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086438656:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642306.716925:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086438656:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642306.716942:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:0.0:1788642306.716954:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:0.0:1788642306.716960:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086438784:12345-192.168.202.49@tcp:400:kworker.0 00000100:00080000:2.0:1788642306.717162:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788642306.717168:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788642306.717617:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086438784:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 27us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642306.717628:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:1.0:1788642306.719280:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086438400 00000100:00100000:1.0:1788642306.719380:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086438400 00000100:00100000:1.0:1788642306.719502:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 292 00000100:00100000:1.0:1788642306.719513:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2361:x1875527086438400:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642306.719651:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2361:x1875527086438400:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 139us (3279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642306.719659:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 292 00000001:00080000:2.0:1788642306.832281:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788642306.832299:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788642306.832354:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788642306.832366:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788642307.002363:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642307.770507:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107420032:0@lo:400:kworker.0 00000100:00100000:0.0:1788642307.770592:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642307.770794:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107420032 00000100:00100000:1.0:1788642307.770802:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107420032 00000100:00100000:1.0:1788642307.770849:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788642307.770858:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3320:x1875527107420032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642307.770949:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107420416:0@lo:400:kworker.0 00000100:00100000:2.0:1788642307.770982:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642307.771016:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107420160:0@lo:400:kworker.0 00000100:00100000:2.0:1788642307.771055:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642307.771075:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788642307.771081:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107420288:0@lo:400:kworker.0 00000100:00100000:2.0:1788642307.771123:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642307.771177:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107420416 00000100:00100000:2.0:1788642307.771180:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107420416 00000100:00100000:2.0:1788642307.771229:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788642307.771236:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107420416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642307.771274:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107420416:12345-0@lo:400:kworker.0 Request processed in 39us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642307.771280:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788642307.771302:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107420160 00000100:00100000:2.0:1788642307.771305:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107420160 00000100:00100000:2.0:1788642307.771324:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107420288 00000100:00100000:2.0:1788642307.771327:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107420288 00000100:00100000:2.0:1788642307.771345:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788642307.771349:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107420160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642307.771382:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107420160:12345-0@lo:400:kworker.0 Request processed in 33us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642307.771387:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788642307.771398:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788642307.771402:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107420288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642307.771425:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107420288:12345-0@lo:400:kworker.0 Request processed in 23us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642307.771430:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1788642307.771445:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788642307.771449:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788642307.771479:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107420416:0@lo:400:kworker.0 00000100:00100000:2.0:1788642307.771504:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107420288:0@lo:400:kworker.0 00000100:00100000:2.0:1788642307.771513:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107420160:0@lo:400:kworker.0 00000100:00100000:1.0:1788642307.776382:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3320:x1875527107420032:12345-0@lo:400:kworker.0 Request processed in 5508us (5772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642307.776402:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788642307.776728:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107420672:0@lo:400:kworker.0 00000100:00100000:1.0:1788642307.776797:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642307.776860:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788642307.776871:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107420544:0@lo:400:kworker.0 00000100:00100000:2.0:1788642307.776901:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642307.776931:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107420544 00000100:00100000:2.0:1788642307.776937:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107420544 00000100:00100000:2.0:1788642307.776983:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788642307.776991:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107420544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642307.777036:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107420544:12345-0@lo:400:kworker.0 Request processed in 45us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642307.777043:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1788642307.777065:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642307.777111:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107420544:0@lo:400:kworker.0 00000100:00100000:2.0:1788642307.777158:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107420672 00000100:00100000:2.0:1788642307.777162:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107420672 00000100:00100000:2.0:1788642307.777192:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788642307.777199:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107420672:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788642307.777282:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788642307.777433:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107420672:12345-0@lo:400:kworker.0 Request processed in 233us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642307.777440:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788642307.777513:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107420032:0@lo:400:kworker.0 00000100:00100000:1.0:1788642307.777631:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107420672:0@lo:400:kworker.0 00010000:00010000:1.0:1788642308.026372:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642308.282455:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107420800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642308.282572:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642308.282851:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107420800 00000100:00100000:1.0:1788642308.282860:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107420800 00000100:00100000:1.0:1788642308.282920:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788642308.282946:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107420800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642308.282990:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642308.283061:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd86b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107420800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642308.283068:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788642308.285154:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107420800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788642309.050476:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642309.306870:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788642309.306898:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107420928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642309.306970:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642309.307202:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107420928 00000100:00100000:3.0:1788642309.307210:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107420928 00000100:00100000:3.0:1788642309.307283:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788642309.307293:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107420928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642309.307328:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642309.307378:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107420928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642309.307385:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788642309.307427:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107420928:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788642309.307494:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788642310.078089:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642311.098478:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788642311.732872:0:12334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 17:05:10 (1788642310) 00000100:00100000:0.0:1788642311.847494:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642311.847544:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642311.847641:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086439040 00000100:00100000:3.0:1788642311.847653:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086439040 00000100:00100000:3.0:1788642311.847718:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 294 00000100:00100000:3.0:1788642311.847728:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2362:x1875527086439040:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642311.847803:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2362:x1875527086439040:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 76us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642311.847810:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 294 00000100:00100000:0.0:1788642311.848155:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642311.848180:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642311.848202:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642311.848294:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086439168 00000100:00100000:3.0:1788642311.848306:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086439168 00000100:00100000:3.0:1788642311.848349:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086439552 00000100:00100000:3.0:1788642311.848352:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086439552 00000100:00100000:3.0:1788642311.848372:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 156 00000100:00100000:3.0:1788642311.848443:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:2361:x1875527086439168:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642311.848485:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:2361:x1875527086439168:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 107us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642311.848492:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 156 00000100:00100000:3.0:1788642311.848505:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 157 00000100:00100000:3.0:1788642311.848511:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2362:x1875527086439552:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642311.848533:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2362:x1875527086439552:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 23us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642311.848539:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 157 00000100:00080000:3.0:1788642311.848558:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642311.855370:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086439296 00000100:00100000:2.0:1788642311.855384:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086439296 00000100:00100000:2.0:1788642311.855450:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086439424 00000100:00100000:2.0:1788642311.855454:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086439424 00000100:00100000:2.0:1788642311.855479:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:2.0:1788642311.855490:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086439296:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642311.855564:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086439296:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 76us (8019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642311.855581:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:2.0:1788642311.855602:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00100000:2.0:1788642311.855608:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086439424:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642311.855632:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086439424:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 23us (7429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642311.855638:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00080000:2.0:1788642311.855671:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788642311.855675:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788642312.123499:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642312.123510:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642312.124070:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788642312.124080:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788642312.124971:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642312.890300:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107421184:0@lo:400:kworker.0 00000100:00100000:1.0:1788642312.890384:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642312.890453:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107421696:0@lo:400:kworker.0 00000100:00100000:1.0:1788642312.890479:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642312.890503:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788642312.890509:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107421312:0@lo:400:kworker.0 00000100:00100000:1.0:1788642312.890538:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642312.890546:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107421056:0@lo:400:kworker.0 00000100:00100000:2.0:1788642312.890596:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642312.890628:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1875527107421568:0@lo:400:kworker.0 00000100:00100000:2.0:1788642312.890653:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642312.890673:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788642312.890678:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107421440:0@lo:400:kworker.0 00000100:00100000:2.0:1788642312.890698:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642312.890731:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107421696 00000100:00100000:2.0:1788642312.890737:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107421696 00000100:00100000:0.0:1788642312.890753:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107421184 00000100:00100000:0.0:1788642312.890756:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107421184 00000100:00100000:2.0:1788642312.890787:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107421440 00000100:00100000:0.0:1788642312.890787:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107421312 00000100:00100000:2.0:1788642312.890790:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107421440 00000100:00100000:0.0:1788642312.890790:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107421312 00000100:00100000:0.0:1788642312.890802:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107421568 00000100:00100000:0.0:1788642312.890804:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107421568 00000100:00100000:2.0:1788642312.890810:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788642312.890817:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788642312.890818:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107421696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642312.890836:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107421184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642312.890871:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107421184:12345-0@lo:400:kworker.0 Request processed in 35us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642312.890874:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107421696:12345-0@lo:400:kworker.0 Request processed in 58us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642312.890878:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788642312.890885:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788642312.890904:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788642312.890906:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788642312.890910:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107421312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642312.890912:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107421440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642312.890938:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107421312:12345-0@lo:400:kworker.0 Request processed in 28us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642312.890940:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107421440:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642312.890944:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788642312.890945:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788642312.890955:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788642312.890960:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875527107421568:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788642312.890963:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788642312.890967:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788642312.890969:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788642312.891004:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107421440:0@lo:400:kworker.0 00000100:00100000:0.0:1788642312.891156:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875527107421568:12345-0@lo:400:kworker.0 Request processed in 195us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642312.891163:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788642312.891216:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107421056 00000100:00100000:0.0:1788642312.891220:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107421056 00000100:00100000:0.0:1788642312.891243:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788642312.891248:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107421312:0@lo:400:kworker.0 00000100:00100000:0.0:1788642312.891249:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3320:x1875527107421056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642312.891258:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107421696:0@lo:400:kworker.0 00000100:00100000:1.0:1788642312.891267:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107421184:0@lo:400:kworker.0 00000100:00100000:0.0:1788642312.891278:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3320:x1875527107421056:12345-0@lo:400:kworker.0 Request processed in 30us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642312.891284:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788642312.895940:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1875527107421568:0@lo:400:kworker.0 00000100:00100000:2.0:1788642312.895983:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107421056:0@lo:400:kworker.0 00010000:00010000:3.0:1788642313.146345:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642313.402692:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788642313.402717:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107421824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642313.402789:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642313.403035:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107421824 00000100:00100000:1.0:1788642313.403044:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107421824 00000100:00100000:1.0:1788642313.403125:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788642313.403136:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107421824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642313.403170:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642313.403217:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107421824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642313.403225:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788642313.403397:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107421824:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788642314.170442:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642314.301967:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642314.302164:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086439808 00000100:00100000:0.0:1788642314.302174:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086439808 00000100:00100000:0.0:1788642314.302262:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 137 00000100:00100000:0.0:1788642314.302286:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:11318:x1875527086439808:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788642314.302325:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642314.302347:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666daba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9961 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.302432:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dac1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.302448:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dac1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788642314.302643:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788642314.302773:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dac1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.302839:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dac8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.302848:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dac8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.302856:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dac8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.311016:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dacf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.311044:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dacf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.311346:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dacf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642314.311361:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788642314.313330:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dac1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.313346:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dac1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.313353:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dac1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.313359:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642314.313364:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dac1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.313372:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dac1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.313389:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ddde00fbe00) 00010000:00010000:0.0:1788642314.313392:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642314.313398:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dac1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.313403:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dac1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.313418:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dac8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.313423:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dac8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.313429:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dac8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.314207:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5ce00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642314.314215:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dac8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.314225:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dac8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.314237:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8dddc2c20b00) 00010000:00010000:0.0:1788642314.314241:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642314.314244:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dac8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.314251:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dac8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.316451:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666daba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9961 expref: 16 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.316557:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dacf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9961 expref: 15 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.316566:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365f900) 00010000:00010000:0.0:1788642314.316569:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642314.316572:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5c000, rc 0) 00000100:00100000:1.0:1788642314.323702:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:11318:x1875527086439808:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 21350us (21667us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788642314.323716:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 137 00000100:00100000:2.0:1788642314.326845:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642314.326925:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086439936 00000100:00100000:0.0:1788642314.326934:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086439936 00000100:00100000:0.0:1788642314.327003:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:0.0:1788642314.327012:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddde4e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:2361:x1875527086439936:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642314.327045:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642314.327084:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dacf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9961 expref: 15 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642314.327146:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365f900) 00010000:00010000:0.0:1788642314.327152:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642314.327213:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddde4e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:2361:x1875527086439936:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 203us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642314.327220:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:0.0:1788642314.336886:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642314.337129:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086440064 00000100:00100000:3.0:1788642314.337140:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086440064 00000100:00100000:3.0:1788642314.337199:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 138 00000100:00100000:3.0:1788642314.337211:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:11318:x1875527086440064:12345-192.168.202.49@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788642314.337332:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:11318:x1875527086440064:12345-192.168.202.49@tcp:59:lhsmtool_posix.0 Request processed in 123us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642314.337340:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 138 00000100:00100000:2.0:1788642314.426529:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107421952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788642314.426749:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642314.427291:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107421952 00000100:00100000:1.0:1788642314.427303:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107421952 00000100:00100000:1.0:1788642314.427453:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788642314.427466:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107421952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788642314.427505:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788642314.427706:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642314.427729:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107421952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 266us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642314.427738:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788642314.427791:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107421952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788642315.194217:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788642315.206218:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788642315.206230:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788642315.206995:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1788642315.207009:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788642316.218621:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642316.525523:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642316.525639:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086440192 00000100:00100000:0.0:1788642316.525653:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086440192 00000100:00100000:0.0:1788642316.525778:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 139 00000100:00100000:0.0:1788642316.525790:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:11360:x1875527086440192:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788642316.525813:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642316.525834:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dadd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9968 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.525902:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dae4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.525917:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dae4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.525946:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dae4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.525961:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666daeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.525969:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666daeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.525975:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666daeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526319:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dae4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526328:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dae4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526335:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dae4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526341:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5cc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642316.526346:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dae4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526355:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dae4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526369:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:0.0:1788642316.526372:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642316.526378:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526391:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526406:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666daeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526412:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666daeb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526418:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666daeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526424:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642316.526427:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666daeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526433:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666daeb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526441:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8dddc2c20b00) 00010000:00010000:0.0:1788642316.526443:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642316.526446:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666daeb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526452:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666daeb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526492:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dadd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9968 expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526515:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:0.0:1788642316.526518:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642316.526523:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dadd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9968 expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.526533:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5c800, rc 0) 00000100:00100000:0.0:1788642316.526620:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:11360:x1875527086440192:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 832us (1117us total) trans 0 rc 301/301 00000100:00100000:0.0:1788642316.526628:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 139 00000100:00080000:2.0:1788642316.527079:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642316.539018:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642316.539117:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086440448 00000100:00100000:3.0:1788642316.539130:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086440448 00000100:00100000:3.0:1788642316.539207:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 140 00000100:00100000:3.0:1788642316.539219:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:11360:x1875527086440448:12345-192.168.202.49@tcp:36:lfs.0 00010000:00010000:3.0:1788642316.539291:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642316.539324:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121e00/0x4ae1ee156666d45b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97a1 expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.539346:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:3.0:1788642316.539364:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642316.539631:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.539647:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666dab3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a995a expref: 5 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.539656:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.539693:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666dab3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a995a expref: 5 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.539707:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666dab3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a995a expref: 5 pid: 5863 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642316.539733:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107422080:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642316.539839:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd91fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788642316.544484:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107422080:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788642316.544530:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642316.544962:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642316.545812:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086440576 00000100:00100000:3.0:1788642316.545822:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086440576 00010000:00010000:3.0:1788642316.545923:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666dab3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a995a expref: 6 pid: 5863 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642316.545973:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:3.0:1788642316.545986:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2359:x1875527086440576:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642316.546004:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642316.546012:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666dab3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a995a expref: 6 pid: 5863 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.546027:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666dab3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a995a expref: 6 pid: 5863 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.546052:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666dab3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a995a expref: 6 pid: 5863 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.546086:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:3.0:1788642316.546091:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.546122:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.546131:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.546166:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642316.546223:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2359:x1875527086440576:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 240us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642316.546230:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 59 00010000:00010000:3.0:1788642316.546266:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.546274:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.546300:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666daf9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.546311:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666daf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.546319:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666daf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642316.547678:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788642316.547694:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.547703:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.547710:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.547728:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642316.547734:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.547751:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.547766:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ddde00fb900) 00010000:00010000:3.0:1788642316.547769:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642316.547774:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.547781:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666daf2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788642316.547799:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008edaf324 reply state 00000000d70a143e transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666daf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642316.547808:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788642316.547894:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:11360:x1875527086440448:12345-192.168.202.49@tcp:36:lfs.0 Request processed in 8673us (8890us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788642316.547902:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 140 00010000:00010000:1.0:1788642316.555177:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666daf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.555200:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666daf9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.555209:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666daf9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.555216:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642316.555221:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666daf9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.555229:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666daf9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.555248:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ddde02b5900) 00010000:00010000:1.0:1788642316.555252:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642316.555280:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666daf9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.555288:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666daf9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788642316.555681:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642316.676568:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642316.687773:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086440704 00000100:00100000:1.0:1788642316.687796:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086440704 00000100:00100000:1.0:1788642316.688482:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 141 00000100:00100000:1.0:1788642316.688497:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:11368:x1875527086440704:12345-192.168.202.49@tcp:101:lctl.0 00010000:00010000:1.0:1788642316.688526:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642316.688553:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666db00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a996f expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.688634:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666db07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.688651:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666db07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.688664:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666db07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642316.688702:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788642316.688706:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642316.688741:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666db07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.688766:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666db00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a996f expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.688803:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666db07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a996f expref: 15 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.688811:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365ff00) 00010000:00010000:1.0:1788642316.688814:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788642316.688818:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51000, rc 0) 00000100:00100000:1.0:1788642316.689270:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:11368:x1875527086440704:12345-192.168.202.49@tcp:101:lctl.0 Request processed in 774us (12773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642316.689279:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 141 00000100:00100000:3.0:1788642316.787063:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642316.787242:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086440832 00000100:00100000:1.0:1788642316.787253:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086440832 00000100:00100000:1.0:1788642316.787321:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 142 00000100:00100000:1.0:1788642316.787349:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+15:11374:x1875527086440832:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788642316.787370:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642316.787393:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666db0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9976 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787453:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666db15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787464:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666db15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787473:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666db15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787483:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787499:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787504:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787597:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666db23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787605:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666db23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787612:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666db23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642316.787637:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788642316.787641:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642316.787656:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666db23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787666:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666db15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787671:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666db15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787675:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666db15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787691:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642316.787694:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666db15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787713:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666db15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787726:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365ff00) 00010000:00010000:1.0:1788642316.787729:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642316.787734:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666db15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787742:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666db15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787757:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787763:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787768:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787773:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642316.787776:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787781:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787787:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8dddc365fd00) 00010000:00010000:1.0:1788642316.787790:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642316.787792:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.787808:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.789773:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666db0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9976 expref: 17 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.789823:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666db23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9976 expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642316.789834:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:1.0:1788642316.789837:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788642316.789841:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51e00, rc 0) 00000100:00100000:2.0:1788642316.792498:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:11374:x1875527086440832:12345-192.168.202.49@tcp:101:bash.0 Request processed in 5138us (5431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642316.792526:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 142 00000100:00100000:2.0:1788642316.798921:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642316.799089:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086441088 00000100:00100000:3.0:1788642316.799129:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086441088 00000100:00100000:3.0:1788642316.799341:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 143 00000100:00100000:3.0:1788642316.799354:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+16:11374:x1875527086441088:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788642316.799377:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642316.799397:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666db2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a997d expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.799742:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666db31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.799789:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666db31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.799803:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666db31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.800223:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666db38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.800235:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666db38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.800244:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666db38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788642316.802452:0:9441:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788642316.802958:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666db3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.802976:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666db3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.802987:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666db3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.803030:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666db31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.803038:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666db31 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.803045:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666db31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.803062:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0031600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642316.803067:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666db31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.803075:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666db31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.803088:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:3.0:1788642316.803091:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642316.803096:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666db31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.803124:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031600/0x4ae1ee156666db31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788642316.803138:0:9441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057ef7fac reply state 0000000080b54062 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666db38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642316.803148:0:9441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788642316.803185:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031000/0x4ae1ee156666db2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a997d expref: 19 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.803332:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666db3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a997d expref: 18 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642316.803412:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:3.0:1788642316.803414:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642316.803416:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddc0031400, rc 0) 00000100:00100000:3.0:1788642316.804724:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:11374:x1875527086441088:12345-192.168.202.49@tcp:101:bash.0 Request processed in 5365us (5806us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788642316.804983:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 143 00010000:00010000:2.0:1788642316.811712:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666db38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.811732:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666db38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.811740:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666db38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.811756:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc0030c00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642316.811762:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666db38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.811771:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666db38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.811788:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ddde02b5800) 00010000:00010000:2.0:1788642316.811791:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642316.811797:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666db38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.811803:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0030c00/0x4ae1ee156666db38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642316.814590:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642316.814693:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086441216 00000100:00100000:0.0:1788642316.814712:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086441216 00000100:00100000:0.0:1788642316.817241:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:0.0:1788642316.817261:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086441216:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788642316.817281:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642316.817301:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666db4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9984 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788642316.817332:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642316.817354:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1788642316.817358:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642316.817368:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666db4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9984 expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.817411:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666db4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9984 expref: 6 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642316.817424:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5cc00, rc 0) 00000100:00100000:0.0:1788642316.817502:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086441216:12345-192.168.202.49@tcp:101:bash.0 Request processed in 249us (2921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642316.817509:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00080000:2.0:1788642316.828312:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788642316.834930:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642316.843230:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086441344 00000100:00100000:2.0:1788642316.843252:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086441344 00000100:00100000:2.0:1788642316.843360:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:2.0:1788642316.843371:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:11374:x1875527086441344:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788642316.843390:0:9442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642316.843411:0:9442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a998b expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.843454:0:9442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666db4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9984 expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.843464:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642316.843468:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642316.843474:0:9442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 7 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.843508:0:9442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666db4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9984 expref: 7 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.843522:0:9442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666db4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9984 expref: 7 pid: 6712 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642316.843545:0:9442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9442:1875527107422208:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788642316.843673:0:9442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfaaf8300 going to sleep for 11 seconds 00000100:00100000:2.0:1788642316.846515:0:9442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9442:1875527107422208:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642316.846558:0:9442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 7 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.846608:0:9442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1e00, rc 0) 00000100:00100000:2.0:1788642316.846666:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:11374:x1875527086441344:12345-192.168.202.49@tcp:101:bash.0 Request processed in 3297us (11751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642316.846677:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:3.0:1788642316.849477:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642316.850320:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086441472 00000100:00100000:2.0:1788642316.850332:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086441472 00010000:00010000:2.0:1788642316.850459:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666db4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9984 expref: 7 pid: 6712 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642316.850565:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:2.0:1788642316.850577:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086441472:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642316.850595:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642316.850623:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666db4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9984 expref: 7 pid: 6712 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.850636:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666db4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9984 expref: 7 pid: 6712 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.850666:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666db4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9984 expref: 7 pid: 6712 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.850685:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642316.850689:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642316.850698:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 6 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.850732:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 6 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642316.850847:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 6 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642316.850862:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5846:1875527107422336:192.168.202.49@tcp:105: 00000100:00100000:2.0:1788642316.850974:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfaaf8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788642316.855068:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642316.855532:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5846:1875527107422336:192.168.202.49@tcp:105: 00010000:00010000:2.0:1788642316.855558:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642316.855613:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086441472:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 5039us (6145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642316.855626:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:1.0:1788642316.860068:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086441728 00000100:00100000:1.0:1788642316.860085:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086441728 00000100:00100000:1.0:1788642316.862723:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:1.0:1788642316.862823:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:11374:x1875527086441728:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:1.0:1788642316.867636:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:11374:x1875527086441728:12345-192.168.202.49@tcp:35:bash.0 Request processed in 4816us (12567us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788642316.867653:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:0.0:1788642316.955732:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642316.955827:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642316.955935:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086441984 00000100:00100000:2.0:1788642316.955947:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086441984 00000100:00100000:2.0:1788642316.956022:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00100000:2.0:1788642316.956032:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086441984:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642316.956146:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086441984:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 115us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642316.956162:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00080000:0.0:1788642316.957531:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788642316.957861:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086441856 00000100:00100000:3.0:1788642316.957871:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086441856 00000100:00100000:3.0:1788642316.957973:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 296 00000100:00100000:3.0:1788642316.957983:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2361:x1875527086441856:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642316.958058:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2361:x1875527086441856:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 76us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642316.958066:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 296 00000100:00100000:0.0:1788642317.019276:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642317.019512:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086442240 00000100:00100000:3.0:1788642317.019522:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086442240 00000100:00100000:3.0:1788642317.019596:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 144 00000100:00100000:3.0:1788642317.019608:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:11384:x1875527086442240:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642317.019639:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642317.019665:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666db5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9992 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642317.019781:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788642317.020014:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666db5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9992 expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.020030:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365ff00) 00010000:00010000:3.0:1788642317.020034:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788642317.020040:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666db5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9992 expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.020073:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaa200, rc 0) 00000100:00100000:3.0:1788642317.020171:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:11384:x1875527086442240:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 564us (911us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788642317.020179:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 144 00000100:00100000:0.0:1788642317.024632:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642317.025046:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086442496 00000100:00100000:3.0:1788642317.025059:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086442496 00000100:00100000:0.0:1788642317.025449:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:0.0:1788642317.025469:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:11384:x1875527086442496:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788642317.026669:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:11384:x1875527086442496:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 1198us (2040us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788642317.026682:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 37 00000001:00080000:2.0:1788642317.103883:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000001:00080000:2.0:1788642317.103905:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000100:00100000:0.0:1788642317.141043:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642317.141520:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086442624 00000100:00100000:1.0:1788642317.141534:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086442624 00000100:00100000:1.0:1788642317.141742:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 145 00000100:00100000:1.0:1788642317.141754:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+17:11390:x1875527086442624:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642317.141780:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642317.141801:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666db69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9999 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.141898:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.141916:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.141928:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642317.141965:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788642317.141969:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642317.141989:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.142018:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666db69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9999 expref: 19 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.142035:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9999 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.142045:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:1.0:1788642317.142048:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788642317.142053:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51600, rc 0) 00000100:00100000:1.0:1788642317.142201:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:11390:x1875527086442624:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 449us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642317.142209:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 145 00000100:00100000:3.0:1788642317.149029:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642317.149430:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086442880 00000100:00100000:0.0:1788642317.149441:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086442880 00000100:00100000:0.0:1788642317.149683:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 146 00000100:00100000:0.0:1788642317.149709:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:11390:x1875527086442880:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788642317.149763:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642317.149789:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666db77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99a0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.149905:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666db7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.149921:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666db7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.149933:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666db7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642317.149944:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788642317.150095:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666db77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99a0 expref: 21 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.150153:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666db7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99a0 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.150164:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:0.0:1788642317.150167:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788642317.150171:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5cc00, rc 0) 00000100:00100000:0.0:1788642317.150250:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:11390:x1875527086442880:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 544us (1230us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788642317.150258:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 146 00000100:00100000:2.0:1788642317.154196:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642317.154482:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086443008 00000100:00100000:0.0:1788642317.154492:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086443008 00000100:00100000:0.0:1788642317.154561:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:0.0:1788642317.154671:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:2359:x1875527086443008:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642317.154697:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642317.154797:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666db7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99a0 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.154816:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:0.0:1788642317.154821:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642317.154881:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:2359:x1875527086443008:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 215us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642317.154888:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:3.0:1788642317.157198:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642317.157290:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086443264 00000100:00100000:0.0:1788642317.157300:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086443264 00000100:00100000:0.0:1788642317.157362:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 147 00000100:00100000:0.0:1788642317.157372:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:11390:x1875527086443264:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788642317.157396:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642317.157417:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d600/0x4ae1ee156666db8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99a7 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.157513:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666db93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.157528:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666db93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.157539:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666db93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642317.157550:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788642317.157732:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d600/0x4ae1ee156666db8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99a7 expref: 22 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.157750:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666db93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99a7 expref: 21 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.157758:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:0.0:1788642317.157761:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788642317.157764:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5de00, rc 0) 00000100:00100000:0.0:1788642317.157818:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:11390:x1875527086443264:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 448us (631us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788642317.157826:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 147 00000100:00100000:3.0:1788642317.165573:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642317.165680:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086443392 00000100:00100000:0.0:1788642317.165701:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086443392 00000100:00100000:0.0:1788642317.165777:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:0.0:1788642317.165788:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2361:x1875527086443392:12345-192.168.202.49@tcp:1:lfs.0 00010000:00010000:0.0:1788642317.165842:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.165864:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 6 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.165873:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642317.165878:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788642317.165883:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.165924:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 6 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.165955:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 6 pid: 9442 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642317.165977:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1875527107422464:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642317.166081:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642317.170413:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642317.170550:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086443520 00000100:00100000:3.0:1788642317.170564:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086443520 00000100:00100000:0.0:1788642317.170610:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1875527107422464:192.168.202.49@tcp:104: 00002000:00100000:3.0:1788642317.170635:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8dddfa8daa00 x1875527086443520/t0(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:518/0 lens 504/0 e 0 to 0 dl 1788642328 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1788642317.170643:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1788642317.170646:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddfa8daa00 with x1875527086443520 ext(0->12) 00010000:00010000:3.0:1788642317.170654:0:6716:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 7 pid: 9442 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.170669:0:6716:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 7 pid: 9442 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788642317.170677:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dddfa8daa00 00000100:00100000:3.0:1788642317.170725:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:3.0:1788642317.170814:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086443520:12345-192.168.202.49@tcp:4:lfs.0 00000100:00100000:2.0:1788642317.171977:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2359:x1875527086443520:12345-192.168.202.49@tcp:4:lfs.0 Request processed in 918us (1324us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788642317.171990:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00002000:00100000:2.0:1788642317.172001:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8dddfa8daa00 x1875527086443520/t4294967305(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:518/0 lens 504/448 e 0 to 0 dl 1788642328 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788642317.172010:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddfa8daa00 with x1875527086443520 ext(0->12) 00010000:00010000:2.0:1788642317.172018:0:6716:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 9 pid: 9442 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.172034:0:6716:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 9 pid: 9442 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788642317.172042:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dddfa8daa00 00000100:00100000:1.0:1788642317.177294:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642317.177617:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086443648 00000100:00100000:2.0:1788642317.177628:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086443648 00010000:00010000:2.0:1788642317.177672:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 9 pid: 9442 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642317.177835:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:2.0:1788642317.177847:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2362:x1875527086443648:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642317.177863:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788642317.177882:0:5846:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788642317.177885:0:5846:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788642316 00002000:00010000:2.0:1788642317.177888:0:5846:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788642317 00002000:00010000:2.0:1788642317.177890:0:5846:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788642316 00010000:00010000:2.0:1788642317.177897:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 9 pid: 9442 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.177928:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 9 pid: 9442 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.177954:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045f53aba/0x4ae1ee156666db54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a998b expref: 9 pid: 9442 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.177974:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788642317.177979:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788642317.177985:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.177995:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.178031:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642317.178120:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.178130:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.178166:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.178175:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.178183:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.178202:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642317.178207:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642317.178209:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2362:x1875527086443648:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 364us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642317.178217:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 61 00010000:00010000:0.0:1788642317.178227:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.178240:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.178248:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666dba1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642317.178301:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2361:x1875527086443392:12345-192.168.202.49@tcp:1:lfs.0 Request processed in 12515us (12737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642317.178308:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:3.0:1788642317.182455:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642317.182533:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086443904 00000100:00100000:0.0:1788642317.182545:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086443904 00000100:00100000:0.0:1788642317.182701:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:0.0:1788642317.182712:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddddbdca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:11390:x1875527086443904:12345-192.168.202.49@tcp:35:lfs.0 00000004:00010000:0.0:1788642317.182861:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666db93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99a7 expref: 21 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788642317.183296:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788642317.183386:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788642317.184633:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788642317.185068:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.185245:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666db3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a997d expref: 25 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.185256:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.185302:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666db3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a997d expref: 25 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.185394:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666db3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a997d expref: 25 pid: 9441 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642317.185411:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1875527107422592:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642317.185576:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddef9f6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788642317.189084:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642317.189649:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1875527107422592:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788642317.189706:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642317.190527:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086444032 00000100:00100000:0.0:1788642317.190536:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086444032 00010000:00010000:0.0:1788642317.190645:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666db3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a997d expref: 26 pid: 9441 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642317.190695:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:0.0:1788642317.190706:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:2360:x1875527086444032:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642317.192485:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642317.192508:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666db3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a997d expref: 26 pid: 9441 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.192529:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666db3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a997d expref: 26 pid: 9441 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.192554:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031400/0x4ae1ee156666db3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a997d expref: 26 pid: 9441 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.192593:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:1.0:1788642317.192599:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.192608:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.192616:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642317.192654:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642317.192700:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.192709:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642317.192832:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:2360:x1875527086444032:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 2126us (3760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642317.192842:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 62 00000001:00080000:3.0:1788642317.192856:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788642317.193069:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1788642317.193237:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875527107422720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788642317.193308:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642317.193341:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd91fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642317.193607:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107422720 00000100:00100000:1.0:1788642317.193615:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107422720 00000100:00100000:1.0:1788642317.193681:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788642317.193699:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1875527107422720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1788642317.193725:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642317.193786:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1875527107422720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642317.193793:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788642317.193835:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875527107422720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788642317.194533:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788642317.194693:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8dad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875527107422848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788642317.194856:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642317.197026:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfaaf8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788642317.197998:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107422848 00000100:00100000:1.0:1788642317.198011:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107422848 00000100:00100000:1.0:1788642317.198070:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788642317.198081:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1875527107422848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788642317.198808:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5864:x1875527107422848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 726us (3949us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788642317.198833:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788642317.198909:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8dad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875527107422848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788642317.198990:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788642317.199037:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.199048:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.199057:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.199063:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642317.199069:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.199078:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.199230:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:2.0:1788642317.199234:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788642317.199240:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.199248:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dba8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788642317.199598:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788642317.199715:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788642317.199726:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404660627452ns, next at 405660625216ns, rc = 0 00000001:00080000:2.0:1788642317.199805:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788642317.199844:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5e00) 00010000:00010000:2.0:1788642317.199848:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788642317.199865:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666db93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99a7 expref: 29 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642317.200039:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddddbdca050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:11390:x1875527086443904:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 17328us (17597us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788642317.200048:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 38 00000020:00080000:2.0:1788642317.200053:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788642317.205200:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642317.205305:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086444160 00000100:00100000:2.0:1788642317.205327:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086444160 00000100:00100000:2.0:1788642317.205385:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 148 00000100:00100000:2.0:1788642317.205395:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:11390:x1875527086444160:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642317.205419:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642317.205440:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666dbaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99ae expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.205513:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666dbaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ae expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.205527:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666dbaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ae expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.205544:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:2.0:1788642317.205546:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788642317.205550:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1e00, rc 0) 00000100:00100000:2.0:1788642317.205612:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:11390:x1875527086444160:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 218us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642317.205619:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 148 00000100:00100000:0.0:1788642317.210404:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642317.210892:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086444416 00000100:00100000:1.0:1788642317.210906:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086444416 00000100:00100000:1.0:1788642317.210979:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:1.0:1788642317.210990:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:11390:x1875527086444416:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:1.0:1788642317.211703:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:11390:x1875527086444416:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 712us (1306us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788642317.211712:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 39 00010000:00010000:1.0:1788642317.243893:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642317.315224:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642317.315429:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086444672 00000100:00100000:0.0:1788642317.315438:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086444672 00000100:00100000:0.0:1788642317.315498:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 149 00000100:00100000:0.0:1788642317.315506:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+30:11400:x1875527086444672:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788642317.315527:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642317.315545:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99b5 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642317.315634:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788642317.315972:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbb6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99b5 expref: 32 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.315987:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365ff00) 00010000:00010000:0.0:1788642317.315990:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788642317.315995:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99b5 expref: 32 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.316009:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5c400, rc 0) 00000100:00100000:0.0:1788642317.316270:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:11400:x1875527086444672:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 762us (1059us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788642317.316278:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 149 00000100:00100000:2.0:1788642317.321769:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642317.321879:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086444800 00000100:00100000:0.0:1788642317.321890:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086444800 00000100:00100000:0.0:1788642317.321964:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 150 00000100:00100000:0.0:1788642317.321974:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:11400:x1875527086444800:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:0.0:1788642317.322048:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322066:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322079:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322095:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322133:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322140:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322421:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322431:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322439:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788642317.322481:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322501:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322509:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322516:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322522:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642317.322526:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322535:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322547:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:0.0:1788642317.322549:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642317.322554:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322559:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322571:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322577:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322583:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322594:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642317.322597:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322603:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322611:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc2c20b00) 00010000:00010000:0.0:1788642317.322613:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642317.322616:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322623:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322637:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322644:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322649:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322654:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642317.322656:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322663:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322695:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:0.0:1788642317.322697:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642317.322701:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.322706:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642317.322795:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:11400:x1875527086444800:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 821us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642317.322804:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 150 00000100:00100000:1.0:1788642317.328697:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642317.328998:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086445056 00000100:00100000:2.0:1788642317.329011:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086445056 00000100:00100000:2.0:1788642317.329076:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:2.0:1788642317.329092:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:11400:x1875527086445056:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788642317.330875:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+32:11400:x1875527086445056:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 1779us (2191us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788642317.330887:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:1.0:1788642317.395810:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642317.395980:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086445312 00000100:00100000:0.0:1788642317.395990:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086445312 00000100:00100000:0.0:1788642317.396062:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 151 00000100:00100000:0.0:1788642317.396075:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+32:11403:x1875527086445312:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788642317.396137:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642317.396164:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99bc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396257:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbe0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396275:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396290:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396312:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396335:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396346:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396617:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dbee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396627:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dbee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396714:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dbee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642317.396735:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788642317.396850:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396862:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbe0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396870:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbe0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396875:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642317.396881:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbe0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396889:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbe0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396914:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:0.0:1788642317.396917:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642317.396923:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbe0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396930:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbe0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396944:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.396950:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbe7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.397031:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.397039:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642317.397043:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.397050:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.397061:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc2c20b00) 00010000:00010000:0.0:1788642317.397064:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642317.397067:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbe7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.397072:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dbe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.397185:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dbd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99bc expref: 35 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.397199:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dbee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99bc expref: 34 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.397206:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:0.0:1788642317.397208:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788642317.397210:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5c800, rc 0) 00000100:00100000:0.0:1788642317.397475:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:11403:x1875527086445312:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1399us (1674us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788642317.397483:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 151 00000100:00100000:1.0:1788642317.402694:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642317.404887:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086445440 00000100:00100000:0.0:1788642317.404900:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086445440 00000100:00100000:0.0:1788642317.404963:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 152 00000100:00100000:0.0:1788642317.404973:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:11403:x1875527086445440:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:0.0:1788642317.405040:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.405054:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.405080:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.405137:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.405157:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.405162:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.405166:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642317.405169:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.405175:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.405184:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:0.0:1788642317.405186:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788642317.405190:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642317.405194:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666dbfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642317.405527:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:11403:x1875527086445440:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 553us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642317.405535:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 152 00000100:00100000:1.0:1788642317.408338:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642317.408412:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086445696 00000100:00100000:0.0:1788642317.408423:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086445696 00000100:00100000:0.0:1788642317.408598:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:0.0:1788642317.408611:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:11403:x1875527086445696:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788642317.408902:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+35:11403:x1875527086445696:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 292us (573us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788642317.408925:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:1.0:1788642317.813345:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642317.813712:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086445952 00000100:00100000:3.0:1788642317.813723:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086445952 00000100:00100000:3.0:1788642317.813796:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 153 00000100:00100000:3.0:1788642317.813807:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+35:11435:x1875527086445952:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:3.0:1788642317.813836:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642317.813858:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99c3 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.813966:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.813983:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.813997:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642317.814031:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788642317.814201:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99c3 expref: 38 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.814220:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99c3 expref: 37 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.814242:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:3.0:1788642317.814245:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642317.814248:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaa200, rc 0) 00000100:00100000:3.0:1788642317.814324:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:11435:x1875527086445952:12345-192.168.202.49@tcp:101:cat.0 Request processed in 518us (995us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788642317.814339:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 153 00000100:00100000:1.0:1788642317.818230:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642317.818329:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642317.818951:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086446080 00000100:00100000:3.0:1788642317.818965:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086446080 00000100:00100000:3.0:1788642317.819047:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:3.0:1788642317.819059:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:2362:x1875527086446080:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642317.819078:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642317.819122:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99c3 expref: 37 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.819293:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:3.0:1788642317.819300:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642317.819723:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:2362:x1875527086446080:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 666us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642317.819732:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:3.0:1788642317.819786:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086446336 00000100:00100000:3.0:1788642317.819790:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086446336 00000100:00100000:3.0:1788642317.819821:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:3.0:1788642317.819829:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:11435:x1875527086446336:12345-192.168.202.49@tcp:35:cat.0 00000100:00100000:3.0:1788642317.825211:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:11435:x1875527086446336:12345-192.168.202.49@tcp:35:cat.0 Request processed in 5364us (6863us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788642317.825238:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:0.0:1788642317.968080:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642317.968438:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086446592 00000100:00100000:3.0:1788642317.968448:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086446592 00000100:00100000:3.0:1788642317.968785:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 154 00000100:00100000:3.0:1788642317.968798:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:11441:x1875527086446592:12345-192.168.202.49@tcp:101:dd.0 00010000:00010000:3.0:1788642317.968834:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642317.968838:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788642317.968878:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666db70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9999 expref: 37 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.968898:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:3.0:1788642317.968903:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642317.968918:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc18 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99ca expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.969033:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.969048:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dbee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99bc expref: 37 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.969057:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.969322:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dbee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99bc expref: 37 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.969872:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dbee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99bc expref: 37 pid: 5863 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642317.969887:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107422976:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642317.969988:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd91f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788642317.980010:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642317.980470:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086446720 00000100:00100000:2.0:1788642317.980482:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086446720 00010000:00010000:2.0:1788642317.980549:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dbee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99bc expref: 38 pid: 5863 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642317.980603:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:2.0:1788642317.980614:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddde4e67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+38:2360:x1875527086446720:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642317.980631:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642317.980639:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dbee lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99bc expref: 38 pid: 5863 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.980663:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dbee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99bc expref: 38 pid: 5863 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.980688:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:2.0:1788642317.980916:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.980929:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.980954:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.980974:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642317.981044:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddde4e67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+38:2360:x1875527086446720:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 430us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642317.981052:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 63 00010000:00010000:3.0:1788642317.982888:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666dbee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99bc expref: 37 pid: 5863 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642317.982913:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107422976:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788642317.982940:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.982950:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.982957:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642317.982985:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788642317.983267:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc18 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ca expref: 38 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.983295:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ca expref: 37 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.983321:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:3.0:1788642317.983912:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788642317.983917:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffabe00, rc 0) 00000100:00100000:3.0:1788642317.983991:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:11441:x1875527086446592:12345-192.168.202.49@tcp:101:dd.0 Request processed in 15195us (15924us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788642317.984000:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 154 00000100:00100000:1.0:1788642317.992629:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642317.992886:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086446976 00000100:00100000:3.0:1788642317.992901:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086446976 00000100:00100000:3.0:1788642317.992972:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 155 00000100:00100000:3.0:1788642317.992984:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:11441:x1875527086446976:12345-192.168.202.49@tcp:36:dd.0 00010000:00010000:3.0:1788642317.993630:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.993659:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642317.993672:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788642317.993744:0:9441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788642317.993772:0:9441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000685e1a64 reply state 00000000a8191ca3 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642317.993782:0:9441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788642317.993875:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+40:11441:x1875527086446976:12345-192.168.202.49@tcp:36:dd.0 Request processed in 891us (1256us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788642317.993882:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 155 00000020:00080000:3.0:1788642317.993899:0:9441:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788642317.999252:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.999270:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.999278:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.999285:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaa200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642317.999290:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.999298:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.999316:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:2.0:1788642317.999318:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642317.999323:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642317.999329:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666dc2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642318.011178:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107423232:0@lo:400:kworker.0 00000100:00100000:2.0:1788642318.011185:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107423360:0@lo:400:kworker.0 00000100:00100000:2.0:1788642318.011249:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642318.011282:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107423360 00000100:00100000:1.0:1788642318.011290:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107423360 00000100:00100000:2.0:1788642318.011309:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642318.011328:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107423744:0@lo:400:kworker.0 00000100:00100000:1.0:1788642318.011347:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107423232 00000100:00100000:1.0:1788642318.011352:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107423232 00000100:00100000:2.0:1788642318.011359:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642318.011381:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788642318.011390:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107423360:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788642318.011394:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642318.011407:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107423744 00000100:00100000:2.0:1788642318.011412:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107423744 00000100:00100000:1.0:1788642318.011454:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107423360:12345-0@lo:400:kworker.0 Request processed in 65us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642318.011459:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788642318.011479:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788642318.011489:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788642318.011489:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107423232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642318.011504:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107423744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642318.011518:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107423232:12345-0@lo:400:kworker.0 Request processed in 33us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642318.011524:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788642318.011559:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107423744:12345-0@lo:400:kworker.0 Request processed in 59us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642318.011566:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788642318.011589:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788642318.011616:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107423360:0@lo:400:kworker.0 00000100:00100000:2.0:1788642318.011640:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107423232:0@lo:400:kworker.0 00000100:00100000:2.0:1788642318.011664:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107423744:0@lo:400:kworker.0 00000100:00100000:0.0:1788642318.011814:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107423104:0@lo:400:kworker.0 00000100:00100000:0.0:1788642318.011849:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642318.011887:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1875527107423616:0@lo:400:kworker.0 00000100:00100000:0.0:1788642318.011909:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642318.011929:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788642318.011935:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107423488:0@lo:400:kworker.0 00000100:00100000:0.0:1788642318.011957:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642318.011984:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107423104 00000100:00100000:1.0:1788642318.011989:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107423104 00000100:00100000:0.0:1788642318.011989:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107423488 00000100:00100000:0.0:1788642318.011996:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107423488 00000100:00100000:1.0:1788642318.012026:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788642318.012033:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788642318.012038:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3320:x1875527107423104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642318.012047:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1875527107423488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642318.012087:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3320:x1875527107423104:12345-0@lo:400:kworker.0 Request processed in 53us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642318.012094:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1875527107423488:12345-0@lo:400:kworker.0 Request processed in 50us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642318.012125:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788642318.012156:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107423488:0@lo:400:kworker.0 00000100:00100000:0.0:1788642318.012165:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107423104:0@lo:400:kworker.0 00000100:00100000:0.0:1788642318.012182:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107423616 00000100:00100000:0.0:1788642318.012185:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107423616 00000100:00100000:0.0:1788642318.012211:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788642318.012217:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875527107423616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642318.012246:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875527107423616:12345-0@lo:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642318.012265:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788642318.012289:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1875527107423616:0@lo:400:kworker.0 00000100:00100000:1.0:1788642318.012396:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:2.0:1788642318.013631:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788642318.267233:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642318.366888:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642318.369292:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086447104 00000100:00100000:0.0:1788642318.369306:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086447104 00000100:00100000:0.0:1788642318.369404:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 156 00000100:00100000:0.0:1788642318.369414:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+39:11455:x1875527086447104:12345-192.168.202.49@tcp:101:stat.0 00010000:00010000:0.0:1788642318.369642:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642318.369664:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dc34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99d1 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.369732:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dc3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.369748:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dc3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.369760:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dc3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.369807:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666dc42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.369815:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666dc42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.369821:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666dc42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.370053:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.370213:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ca expref: 40 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.370223:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc49 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788642318.370372:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788642318.370515:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ca expref: 40 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.370534:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ca expref: 40 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642318.370551:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107423872:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642318.370740:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788642318.375161:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642318.375389:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086447360 00000100:00100000:2.0:1788642318.375400:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086447360 00000100:00100000:2.0:1788642318.375470:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:2.0:1788642318.375478:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+41:5613:x1875527086447360:12345-192.168.202.49@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788642318.375824:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+42:5613:x1875527086447360:12345-192.168.202.49@tcp:35:ldlm_bl.0 Request processed in 345us (670us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788642318.375844:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:0.0:1788642318.376955:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab0ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107423872:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642318.376984:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642318.379329:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642318.379417:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086447488 00000100:00100000:3.0:1788642318.379435:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086447488 00010000:00010000:3.0:1788642318.379477:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ca expref: 42 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642318.379522:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:3.0:1788642318.379532:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+42:2360:x1875527086447488:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642318.379547:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642318.379554:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ca expref: 42 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642318.379567:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ca expref: 42 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642318.379590:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ca expref: 42 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642318.379605:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:3.0:1788642318.379610:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642318.379619:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642318.379642:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc49 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642318.379674:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642318.379736:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+41:2360:x1875527086447488:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 205us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642318.379756:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 64 00010000:00010000:1.0:1788642318.380555:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380566:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642318.380617:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788642318.380621:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642318.380653:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380678:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380689:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dc3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380695:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dc3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380701:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dc3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380706:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642318.380710:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dc3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380717:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dc3b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380728:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:1.0:1788642318.380732:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642318.380736:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dc3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380741:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dc3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380754:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666dc42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380760:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666dc42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380773:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666dc42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380778:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5da00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642318.380780:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666dc42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380787:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666dc42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380795:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc2c20b00) 00010000:00010000:1.0:1788642318.380797:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642318.380801:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666dc42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380807:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666dc42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380847:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dc34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99d1 expref: 41 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380862:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99d1 expref: 40 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.380869:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:1.0:1788642318.380871:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642318.380874:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5ce00, rc 0) 00000100:00100000:1.0:1788642318.380941:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+40:11455:x1875527086447104:12345-192.168.202.49@tcp:101:stat.0 Request processed in 11528us (14062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642318.380957:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 156 00000100:00100000:1.0:1788642318.506908:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642318.507139:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086447744 00000100:00100000:0.0:1788642318.507150:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086447744 00000100:00100000:0.0:1788642318.507214:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 157 00000100:00100000:0.0:1788642318.507224:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+40:11461:x1875527086447744:12345-192.168.202.49@tcp:36:truncate.0 00010000:00010000:0.0:1788642318.507296:0:9441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642318.507322:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99d1 expref: 40 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.507363:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:0.0:1788642318.507370:0:9441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642318.507615:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dc50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.507641:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dc50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.507649:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dc50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788642318.507701:0:9441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788642318.507727:0:9441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e87dc47 reply state 0000000034e88a3c transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dc50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642318.507736:0:9441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788642318.507849:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+42:11461:x1875527086447744:12345-192.168.202.49@tcp:36:truncate.0 Request processed in 625us (952us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788642318.507856:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 157 00000020:00080000:0.0:1788642318.507862:0:9441:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788642318.515139:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dc50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.515163:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dc50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.515170:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dc50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.515176:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642318.515181:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dc50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.515189:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dc50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.515209:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:1.0:1788642318.515212:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642318.515217:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dc50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.515223:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dc50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642318.522661:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788642318.522686:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107424000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642318.522756:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642318.522984:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107424000 00000100:00100000:0.0:1788642318.522994:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107424000 00000100:00100000:0.0:1788642318.523051:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788642318.523061:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107424000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788642318.523126:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642318.523184:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107424000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642318.523191:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788642318.523385:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107424000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788642318.785202:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642318.785361:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086447872 00000100:00100000:0.0:1788642318.785371:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086447872 00000100:00100000:0.0:1788642318.785440:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 158 00000100:00100000:0.0:1788642318.785451:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+41:11475:x1875527086447872:12345-192.168.202.49@tcp:101:stat.0 00010000:00010000:0.0:1788642318.785474:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642318.785497:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99d8 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.785564:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666dc5e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.785579:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666dc5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.785593:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666dc5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.785619:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dc65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.785627:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dc65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.785634:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dc65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.785973:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.785983:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786000:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642318.786033:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788642318.786037:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788642318.786384:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786398:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786407:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666dc5e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786414:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666dc5e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786421:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666dc5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786426:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5ca00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642318.786431:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666dc5e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786438:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666dc5e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786449:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:0.0:1788642318.786452:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642318.786457:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666dc5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786474:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666dc5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786487:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dc65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786493:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dc65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786499:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dc65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786504:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642318.786507:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dc65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786513:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dc65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786519:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc2c20600) 00010000:00010000:0.0:1788642318.786522:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642318.786524:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dc65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786529:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dc65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786564:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dc57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99d8 expref: 43 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786577:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99d8 expref: 42 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.786590:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:0.0:1788642318.786592:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788642318.786595:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5d800, rc 0) 00000100:00100000:0.0:1788642318.786729:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+42:11475:x1875527086447872:12345-192.168.202.49@tcp:101:stat.0 Request processed in 1278us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642318.786736:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 158 00000100:00100000:0.0:1788642318.904263:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642318.904388:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086448128 00000100:00100000:1.0:1788642318.904398:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086448128 00000100:00100000:1.0:1788642318.904460:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 159 00000100:00100000:1.0:1788642318.904471:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+42:11485:x1875527086448128:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642318.904509:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642318.904533:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666dc73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99df expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642318.904647:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788642318.904777:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666dc73 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99df expref: 44 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.904792:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365ff00) 00010000:00010000:1.0:1788642318.904795:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788642318.904801:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666dc73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99df expref: 44 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.904817:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50800, rc 0) 00000100:00100000:1.0:1788642318.904880:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+43:11485:x1875527086448128:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 411us (627us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788642318.904888:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 159 00000100:00100000:2.0:1788642318.914037:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642318.914735:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086448384 00000100:00100000:0.0:1788642318.914746:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086448384 00000100:00100000:0.0:1788642318.914814:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:0.0:1788642318.914826:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddddbdc9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+43:11485:x1875527086448384:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788642318.915075:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddddbdc9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+44:11485:x1875527086448384:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 250us (1046us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788642318.915084:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:0.0:1788642318.980521:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642318.980777:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086448640 00000100:00100000:1.0:1788642318.980788:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086448640 00000100:00100000:1.0:1788642318.980854:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 160 00000100:00100000:1.0:1788642318.980865:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+44:11490:x1875527086448640:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788642318.980887:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642318.980909:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666dc81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99e6 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.981001:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.981033:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99d8 expref: 45 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.981042:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.981086:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99d8 expref: 45 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642318.981136:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99d8 expref: 45 pid: 5863 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642318.981150:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfacf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107424128:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642318.981388:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddef9f6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788642318.985486:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642318.985650:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086448768 00000100:00100000:2.0:1788642318.985660:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086448768 00010000:00010000:2.0:1788642318.985708:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99d8 expref: 46 pid: 5863 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642318.985757:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:2.0:1788642318.985767:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+46:2360:x1875527086448768:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642318.985785:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642318.985792:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99d8 expref: 46 pid: 5863 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642318.985805:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99d8 expref: 46 pid: 5863 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642318.985826:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:2.0:1788642318.985832:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642318.985842:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642318.985850:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642318.985871:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642318.985933:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+46:2360:x1875527086448768:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 167us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642318.985954:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 65 00010000:00010000:0.0:1788642318.988045:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dc6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99d8 expref: 45 pid: 5863 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642318.988165:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfacf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107424128:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642318.988193:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.988204:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.988211:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642318.988315:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788642318.988552:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666dc81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99e6 expref: 46 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.988570:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99e6 expref: 45 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.988579:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:0.0:1788642318.988582:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788642318.988585:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb51200, rc 0) 00000100:00100000:0.0:1788642318.988715:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+45:11490:x1875527086448640:12345-192.168.202.49@tcp:101:bash.0 Request processed in 7850us (8203us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788642318.988723:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 160 00000100:00100000:1.0:1788642318.991843:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642318.991942:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086449024 00000100:00100000:3.0:1788642318.991954:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086449024 00000100:00100000:3.0:1788642318.992057:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 161 00000100:00100000:3.0:1788642318.992069:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+45:11490:x1875527086449024:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:3.0:1788642318.992408:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642318.992431:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642318.992446:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788642318.992515:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788642318.992541:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b3b78cd reply state 00000000af49bacb transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642318.992551:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788642318.992665:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+48:11490:x1875527086449024:12345-192.168.202.49@tcp:36:bash.0 Request processed in 597us (833us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788642318.992673:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 161 00000020:00080000:3.0:1788642318.992679:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788642318.999573:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642318.999659:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086449152 00000100:00100000:0.0:1788642318.999669:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086449152 00000100:00100000:0.0:1788642318.999735:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 162 00000100:00100000:0.0:1788642318.999746:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+48:11490:x1875527086449152:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788642318.999771:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642318.999794:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666dc9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99ed expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.999894:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.999910:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99e6 expref: 49 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.999937:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.999944:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dca4 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.999960:0:5861:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.999984:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99e6 expref: 49 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642318.999996:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99e6 expref: 49 pid: 5863 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642319.000009:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107424256:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642319.000142:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9acc0 going to sleep for 10 seconds 00010000:00010000:1.0:1788642319.000478:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.000488:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.000494:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.000500:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffabe00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642319.000504:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.000553:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.000568:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:1.0:1788642319.000571:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642319.000574:0:3303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.000583:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.000590:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666dc96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642319.004673:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642319.005065:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086449280 00000100:00100000:3.0:1788642319.005087:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086449280 00010000:00010000:3.0:1788642319.005156:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99e6 expref: 49 pid: 5863 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642319.005194:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:3.0:1788642319.005203:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+49:2360:x1875527086449280:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642319.005215:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642319.005221:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99e6 expref: 49 pid: 5863 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642319.005245:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99e6 expref: 49 pid: 5863 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642319.005266:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:3.0:1788642319.005271:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642319.005281:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642319.005289:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dca4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642319.005306:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642319.005350:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+49:2360:x1875527086449280:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 149us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642319.005357:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 66 00010000:00010000:2.0:1788642319.006368:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dc88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99e6 expref: 48 pid: 5863 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642319.006388:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107424256:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642319.006420:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.006430:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.006435:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642319.006478:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788642319.006482:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788642319.006506:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.006535:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666dc9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ed expref: 48 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.006549:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ed expref: 47 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.006558:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:2.0:1788642319.006561:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788642319.006576:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5d000, rc 0) 00000100:00100000:2.0:1788642319.006642:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+47:11490:x1875527086449152:12345-192.168.202.49@tcp:101:bash.0 Request processed in 6898us (7079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642319.006650:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 162 00000100:00100000:2.0:1788642319.010300:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642319.010497:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086449536 00000100:00100000:3.0:1788642319.010507:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086449536 00000100:00100000:3.0:1788642319.010567:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:3.0:1788642319.010576:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+47:11490:x1875527086449536:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:3.0:1788642319.010813:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+48:11490:x1875527086449536:12345-192.168.202.49@tcp:35:bash.0 Request processed in 237us (521us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788642319.010820:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 45 00000001:00080000:0.0:1788642319.087245:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1788642319.087267:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1788642319.097553:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642319.097673:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086449792 00000100:00100000:1.0:1788642319.097682:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086449792 00000100:00100000:1.0:1788642319.097739:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 163 00000100:00100000:1.0:1788642319.097747:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+48:11501:x1875527086449792:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642319.097768:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642319.097785:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666dcab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99f4 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642319.097875:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788642319.097982:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666dcab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99f4 expref: 50 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.097994:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365ff00) 00010000:00010000:1.0:1788642319.098008:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788642319.098013:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666dcab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99f4 expref: 50 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.098025:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddcfb50800, rc 0) 00000100:00100000:1.0:1788642319.098085:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+49:11501:x1875527086449792:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 338us (548us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788642319.098092:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 163 00000100:00100000:1.0:1788642319.106243:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642319.106302:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086449920 00000100:00100000:2.0:1788642319.106354:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086449920 00000100:00100000:2.0:1788642319.106413:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 164 00000100:00100000:2.0:1788642319.106425:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+49:11501:x1875527086449920:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:2.0:1788642319.106497:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dcb9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106510:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dcb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106520:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dcb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106529:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666dcc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106533:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666dcc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106538:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666dcc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106829:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666dcc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106838:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666dcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106856:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666dcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788642319.106902:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666dcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106912:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dcb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106916:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dcb9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106920:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dcb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106924:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642319.106927:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dcb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106931:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dcb9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106940:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:2.0:1788642319.106942:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642319.106945:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dcb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106949:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dcb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106957:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666dcc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106965:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666dcc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106969:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666dcc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106971:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642319.106973:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666dcc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106976:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666dcc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106981:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc98d9900) 00010000:00010000:2.0:1788642319.106982:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642319.106984:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666dcc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106987:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666dcc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.106996:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666dcc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.107000:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666dcc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.107003:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666dcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.107006:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642319.107011:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666dcc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.107015:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666dcc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.107020:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:2.0:1788642319.107021:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642319.107022:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666dcc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.107025:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666dcc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642319.107185:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+49:11501:x1875527086449920:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 761us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642319.107193:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 164 00000100:00100000:2.0:1788642319.109402:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642319.109486:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086450176 00000100:00100000:3.0:1788642319.109495:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086450176 00000100:00100000:3.0:1788642319.109566:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:3.0:1788642319.109576:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+49:11501:x1875527086450176:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788642319.109819:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+50:11501:x1875527086450176:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 243us (424us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788642319.109826:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:3.0:1788642319.152251:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642319.152769:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086450432 00000100:00100000:1.0:1788642319.152782:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086450432 00000100:00100000:1.0:1788642319.152847:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 165 00000100:00100000:1.0:1788642319.152859:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+50:11504:x1875527086450432:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642319.152889:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642319.152910:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666dcce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a99fb expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153153:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666dcd5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153170:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666dcd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153183:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666dcd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153196:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dcdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153201:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dcdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153216:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dcdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153455:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666dce3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153463:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153468:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642319.153476:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788642319.153553:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666dcd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153559:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666dcd5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153563:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666dcd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153566:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642319.153570:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666dcd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153575:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666dcd5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153582:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:1.0:1788642319.153584:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642319.153604:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666dcd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153611:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51600/0x4ae1ee156666dcd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153625:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dcdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153645:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dcdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153651:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dcdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153656:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642319.153658:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dcdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153663:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dcdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153670:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc365fd00) 00010000:00010000:1.0:1788642319.153672:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642319.153675:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dcdc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.153681:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51200/0x4ae1ee156666dcdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.154407:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50800/0x4ae1ee156666dcce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99fb expref: 53 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.154440:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666dce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99fb expref: 52 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642319.154448:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:1.0:1788642319.154451:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642319.154453:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3ba200, rc 0) 00000100:00100000:1.0:1788642319.155066:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:11504:x1875527086450432:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 2206us (2822us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788642319.155075:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 165 00000100:00100000:1.0:1788642319.161518:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642319.161629:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642319.161789:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086450688 00000100:00100000:0.0:1788642319.161800:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086450688 00000100:00100000:0.0:1788642319.161862:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 166 00000100:00100000:0.0:1788642319.161872:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:11504:x1875527086450688:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:0.0:1788642319.161943:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dcf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.161967:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dcf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.161993:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dcf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.162022:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dcf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.162028:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dcf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.162034:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dcf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.162040:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642319.162044:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dcf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.162051:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dcf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.162063:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:0.0:1788642319.162067:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788642319.162071:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dcf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.162077:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dcf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642319.162198:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:11504:x1875527086450688:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 327us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642319.162205:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 166 00000100:00100000:3.0:1788642319.166300:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086450560 00000100:00100000:3.0:1788642319.166314:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086450560 00000100:00100000:3.0:1788642319.167304:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:3.0:1788642319.167320:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:2360:x1875527086450560:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642319.167333:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642319.167356:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666dce3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99fb expref: 52 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642319.167374:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:3.0:1788642319.167378:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642319.167880:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+51:2360:x1875527086450560:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 561us (6368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642319.167906:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:2.0:1788642319.168495:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642319.168650:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086450944 00000100:00100000:3.0:1788642319.168661:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086450944 00000100:00100000:3.0:1788642319.168749:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:3.0:1788642319.168761:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+51:11504:x1875527086450944:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788642319.168989:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:11504:x1875527086450944:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 231us (495us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788642319.168996:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 47 00010000:00010000:3.0:1788642319.291547:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642319.386079:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642319.387123:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086451200 00000100:00100000:3.0:1788642319.387135:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086451200 00000100:00100000:3.0:1788642319.387203:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 167 00000100:00100000:3.0:1788642319.387214:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:11522:x1875527086451200:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:3.0:1788642319.387237:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642319.387256:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dcf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a02 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642319.387352:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666dcff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642319.387368:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666dcff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642319.387381:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666dcff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642319.387394:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788642319.388909:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dcf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a02 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642319.388941:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666dcff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a02 expref: 54 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642319.388950:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:3.0:1788642319.388953:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788642319.388958:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaac00, rc 0) 00000100:00100000:3.0:1788642319.389129:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:11522:x1875527086451200:12345-192.168.202.49@tcp:101:cat.0 Request processed in 1884us (3026us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788642319.389139:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 167 00000100:00100000:1.0:1788642319.452086:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642319.452274:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086451328 00000100:00100000:0.0:1788642319.452297:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086451328 00000100:00100000:0.0:1788642319.452364:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 168 00000100:00100000:0.0:1788642319.452374:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:11523:x1875527086451328:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788642319.452400:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642319.452421:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dd0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a09 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.452493:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dd14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.452510:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dd14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.452521:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dd14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642319.452569:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788642319.452573:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788642319.452601:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dd14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.452835:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d800/0x4ae1ee156666dd0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a09 expref: 56 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.452857:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dd14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a09 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642319.452867:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:0.0:1788642319.452870:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788642319.452874:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5ce00, rc 0) 00000100:00100000:0.0:1788642319.453000:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:11523:x1875527086451328:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 627us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642319.453007:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 168 00000100:00100000:2.0:1788642319.470955:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642319.478364:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086451712 00000100:00100000:0.0:1788642319.478842:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086451712 00000100:00100000:0.0:1788642319.478985:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:0.0:1788642319.478997:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:11523:x1875527086451712:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788642319.479406:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:11523:x1875527086451712:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 410us (8460us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788642319.479415:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:1.0:1788642319.484935:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642319.485055:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086451840 00000100:00100000:2.0:1788642319.485069:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086451840 00000100:00100000:2.0:1788642319.485186:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788642319.485197:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:11523:x1875527086451840:12345-192.168.202.49@tcp:103:lfs.0 00010000:00010000:2.0:1788642319.485341:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788642319.485378:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ed expref: 56 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.485400:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666dcff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a02 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.485434:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666dbaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a99ae expref: 54 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.485444:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9600) 00010000:00010000:2.0:1788642319.485454:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642319.485516:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+53:11523:x1875527086451840:12345-192.168.202.49@tcp:103:lfs.0 Request processed in 321us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642319.485524:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:1.0:1788642319.490471:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642319.490719:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086451968 00000100:00100000:2.0:1788642319.490729:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086451968 00000100:00100000:2.0:1788642319.490793:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 169 00000100:00100000:2.0:1788642319.490805:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+53:11523:x1875527086451968:12345-192.168.202.49@tcp:58:lfs.0 00010000:00010000:2.0:1788642319.490914:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dd1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.490930:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dd1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.490941:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dd1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788642319.491412:0:9441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788642319.491507:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+53:11523:x1875527086451968:12345-192.168.202.49@tcp:58:lfs.0 Request processed in 701us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642319.491516:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 169 00000100:00100000:1.0:1788642319.541476:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642319.541819:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086452096 00000100:00100000:2.0:1788642319.541830:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086452096 00000100:00100000:2.0:1788642319.541911:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 170 00000100:00100000:2.0:1788642319.541921:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+53:11525:x1875527086452096:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642319.541944:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642319.541963:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666dd22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a10 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.542030:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666dd29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.542046:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666dd29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.542060:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666dd29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.542075:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666dd30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.542082:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666dd30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.542088:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666dd30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.542520:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.542937:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.542951:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642319.543008:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788642319.543013:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788642319.543040:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543056:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543066:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666dd29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543073:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666dd29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543080:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666dd29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543086:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642319.543091:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666dd29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543146:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666dd29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543160:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:2.0:1788642319.543164:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642319.543169:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666dd29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543175:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666dd29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543200:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666dd30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543867:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666dd30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543875:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666dd30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543881:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642319.543885:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666dd30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543893:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666dd30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543905:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc98d9600) 00010000:00010000:2.0:1788642319.543908:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642319.543912:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666dd30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543919:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666dd30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.543990:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1e00/0x4ae1ee156666dd22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a10 expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.544005:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a10 expref: 54 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642319.544030:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9900) 00010000:00010000:2.0:1788642319.544032:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788642319.544036:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0400, rc 0) 00000100:00100000:2.0:1788642319.544170:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:11525:x1875527086452096:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 2249us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642319.544179:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 170 00000004:00080000:1.0:1788642319.547466:0:7034:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407008363280ns, next at 408008359871ns, rc = 0 00000100:00100000:0.0:1788642319.547540:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788642319.547561:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107424384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642319.547780:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642319.547900:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107424384 00000100:00100000:1.0:1788642319.547908:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107424384 00000100:00100000:1.0:1788642319.547966:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788642319.547975:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107424384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788642319.548006:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642319.548048:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107424384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642319.548054:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788642319.548405:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788642319.548411:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788642319.548439:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107424384:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788642319.548727:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788642320.314363:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642320.314375:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642320.314430:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788642320.314437:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788642320.314592:0:11714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11714:1875527107424512:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788642320.314716:0:11714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc2cb69c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788642320.315953:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642320.333664:0:11714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11714:1875527107424512:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788642320.347014:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642320.347985:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086452224 00000100:00100000:2.0:1788642320.347996:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086452224 00000100:00100000:2.0:1788642320.348136:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 171 00000100:00100000:2.0:1788642320.348149:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:11536:x1875527086452224:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788642320.348191:0:9441:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788642320.348292:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:11536:x1875527086452224:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 146us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642320.348300:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 171 00000100:00080000:3.0:1788642320.360040:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642320.363518:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642320.364708:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086452352 00000100:00100000:1.0:1788642320.364723:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086452352 00000100:00100000:1.0:1788642320.364795:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 172 00000100:00100000:1.0:1788642320.364805:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:11536:x1875527086452352:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788642320.364916:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd3e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.364937:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.364958:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.364974:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dd45 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.364981:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dd45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.364987:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dd45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365019:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666dd4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365028:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666dd4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365035:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666dd4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642320.365080:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788642320.365089:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642320.365130:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666dd4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365143:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365150:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd3e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365156:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd3e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365162:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3baa00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642320.365166:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd3e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365173:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd3e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365188:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365f900) 00010000:00010000:1.0:1788642320.365190:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642320.365196:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd3e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365201:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd3e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365211:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dd45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365216:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dd45 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365231:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dd45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365236:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642320.365238:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dd45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365244:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dd45 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365251:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8dddc365f600) 00010000:00010000:1.0:1788642320.365253:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642320.365256:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dd45 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365260:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dd45 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365279:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666dd4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365285:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666dd4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365290:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666dd4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365294:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bae00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642320.365297:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666dd4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365313:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666dd4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365321:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9900) 00010000:00010000:1.0:1788642320.365324:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642320.365327:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666dd4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.365333:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666dd4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642320.365425:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:11536:x1875527086452352:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 Request processed in 620us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642320.365433:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 172 00000100:00100000:1.0:1788642320.374564:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642320.377507:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086452608 00000100:00100000:3.0:1788642320.377524:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086452608 00000100:00100000:2.0:1788642320.378736:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 173 00000100:00100000:2.0:1788642320.378751:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:11536:x1875527086452608:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788642320.378784:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642320.378808:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0c00/0x4ae1ee156666dd53 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a17 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.378917:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666dd5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.378932:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666dd5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.378944:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666dd5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642320.378956:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788642320.379054:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666dd5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.379062:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666dd5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.379068:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666dd5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.379074:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0a00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642320.379079:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666dd5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.381060:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666dd5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.381078:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9900) 00010000:00010000:2.0:1788642320.381090:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788642320.381114:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666dd5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.381122:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666dd5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.381475:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0c00/0x4ae1ee156666dd53 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a17 expref: 56 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.381488:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365f900) 00010000:00010000:2.0:1788642320.381490:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788642320.381494:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0c00/0x4ae1ee156666dd53 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a17 expref: 56 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.381504:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0c00, rc 0) 00000100:00100000:2.0:1788642320.382140:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:11536:x1875527086452608:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 3387us (7580us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788642320.382150:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 173 00000100:00100000:1.0:1788642320.391399:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642320.391483:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086452736 00000100:00100000:0.0:1788642320.391495:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086452736 00000100:00100000:0.0:1788642320.391567:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 174 00000100:00100000:0.0:1788642320.391579:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:11536:x1875527086452736:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788642320.391620:0:5861:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788642320.391741:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:11536:x1875527086452736:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 164us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642320.391749:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 174 00000100:00100000:2.0:1788642320.398822:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642320.402020:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086452992 00000100:00100000:3.0:1788642320.402035:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086452992 00000100:00100000:1.0:1788642320.402449:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 175 00000100:00100000:1.0:1788642320.402461:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:11536:x1875527086452992:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788642320.402482:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642320.402486:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788642320.402511:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666dd14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a09 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.402526:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:1.0:1788642320.402545:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788642320.402560:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dd68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a1e expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788642320.403594:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788642320.403789:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.403804:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.403814:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.403877:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dd68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a1e expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.403893:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a1e expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.403901:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dddc365f600) 00010000:00010000:1.0:1788642320.403904:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642320.403907:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3baa00, rc 0) 00000100:00100000:1.0:1788642320.404021:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:11536:x1875527086452992:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 1561us (5208us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788642320.404029:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 175 00000100:00100000:2.0:1788642320.431644:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642320.431722:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086453248 00000100:00100000:1.0:1788642320.431734:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086453248 00000100:00100000:1.0:1788642320.431810:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 176 00000100:00100000:1.0:1788642320.431821:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:11536:x1875527086453248:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788642320.431902:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642320.431959:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dd6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a1e expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.431981:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dddc365f600) 00010000:00010000:1.0:1788642320.431998:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788642320.432026:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dd7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432043:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dd7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432055:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dd7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432147:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dd84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8d8d8cd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432155:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dd84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8d8cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432171:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dd84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8d8cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432370:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dd7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432378:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dd7d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432385:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dd7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432391:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642320.432401:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dd7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432410:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dd7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432418:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:1.0:1788642320.432421:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642320.432425:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dd7d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432432:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dd7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432441:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dd84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8d8cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432447:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dd84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8d8cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432452:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dd84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8d8cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432457:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bbc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642320.432460:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dd84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8d8cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432466:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dd84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8d8d8cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432472:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8d8d8cd0 (ffff8dddc365f400) 00010000:00010000:1.0:1788642320.432475:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642320.432483:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dd84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8d8d8cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.432489:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dd84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8d8d8cd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642320.432605:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:11536:x1875527086453248:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 784us (971us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788642320.432613:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 176 00000100:00100000:2.0:1788642320.438890:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642320.438982:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086453376 00000100:00100000:3.0:1788642320.438993:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086453376 00000100:00100000:3.0:1788642320.439070:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 177 00000100:00100000:3.0:1788642320.439082:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:11536:x1875527086453376:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788642320.439126:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642320.439155:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dd8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a25 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.439204:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666dd92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.439242:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666dd92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.439256:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666dd92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.439383:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dd8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a25 expref: 57 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.439407:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666dd92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a25 expref: 56 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.439417:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ddde02b5700) 00010000:00010000:3.0:1788642320.439420:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788642320.439424:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffab000, rc 0) 00000100:00100000:3.0:1788642320.439508:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:11536:x1875527086453376:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 428us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642320.439516:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 177 00000100:00100000:3.0:1788642320.450779:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642320.455029:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086453632 00000100:00100000:1.0:1788642320.455048:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086453632 00000100:00100000:0.0:1788642320.457067:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 178 00000100:00100000:0.0:1788642320.457084:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:11536:x1875527086453632:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788642320.457202:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dd99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.457221:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dd99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.457236:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dd99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788642320.457619:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788642320.457631:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407918531900ns, next at 408918529324ns, rc = 0 00000004:00010000:0.0:1788642320.457737:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001639f62f reply state 00000000508e1fde transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dd99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642320.458251:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788642320.460118:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+58:11536:x1875527086453632:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 3007us (9320us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788642320.460131:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 178 00010000:00010000:1.0:1788642320.469147:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dd99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.469177:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dd99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.469185:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dd99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.469190:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642320.469195:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dd99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.469204:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dd99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.469222:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ddde02b5700) 00010000:00010000:1.0:1788642320.469226:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788642320.469230:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dd99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.469236:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dd99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642320.475192:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642320.475299:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086453760 00000100:00100000:0.0:1788642320.475310:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086453760 00000100:00100000:0.0:1788642320.475517:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 179 00000100:00100000:0.0:1788642320.475542:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+57:11536:x1875527086453760:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788642320.475569:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642320.475591:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dda0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a2c expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.475658:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dda0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a2c expref: 58 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.475685:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dda0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a2c expref: 58 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.475709:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ddde02b5700) 00010000:00010000:0.0:1788642320.475713:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788642320.475718:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5c600, rc 0) 00000100:00100000:0.0:1788642320.475800:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+58:11536:x1875527086453760:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 271us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642320.475807:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 179 00000100:00100000:0.0:1788642320.487485:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642320.487828:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086453888 00000100:00100000:1.0:1788642320.487841:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086453888 00000100:00100000:1.0:1788642320.487926:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:1.0:1788642320.487937:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2359:x1875527086453888:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788642320.488350:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788642320.488472:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086453888:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 533us (996us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788642320.488481:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:2.0:1788642320.500958:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642320.501002:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086454144 00000100:00100000:2.0:1788642320.501013:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086454144 00000100:00100000:2.0:1788642320.501077:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:2.0:1788642320.501088:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+58:11536:x1875527086454144:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788642320.501951:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:11536:x1875527086454144:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 861us (1001us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788642320.501961:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 49 00000040:00080000:1.0:1788642320.506985:0:12486:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788642320.506993:0:12486:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788642320.507030:0:12486:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788642320.507038:0:12486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788642320.510728:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642320.511697:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086454400 00000100:00100000:3.0:1788642320.511712:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086454400 00000100:00100000:3.0:1788642320.511778:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 180 00000100:00100000:3.0:1788642320.511790:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:11536:x1875527086454400:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788642320.511912:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:11536:x1875527086454400:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 125us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642320.511920:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 180 00000100:00100000:1.0:1788642320.515086:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642320.515209:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086454528 00000100:00100000:3.0:1788642320.515220:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086454528 00000100:00100000:3.0:1788642320.515297:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 181 00000100:00100000:3.0:1788642320.515309:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:11536:x1875527086454528:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788642320.515329:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642320.515347:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dda7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a33 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.515418:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab200/0x4ae1ee156666ddae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.515433:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab200/0x4ae1ee156666ddae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.515445:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab200/0x4ae1ee156666ddae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642320.515480:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642320.515498:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab200/0x4ae1ee156666ddae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.515524:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dda7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a33 expref: 61 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.515554:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab200/0x4ae1ee156666ddae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a33 expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.515563:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ddde02b5700) 00010000:00010000:3.0:1788642320.515565:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788642320.515569:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffab200, rc 0) 00000100:00100000:3.0:1788642320.515644:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:11536:x1875527086454528:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 337us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642320.515652:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 181 00000100:00100000:0.0:1788642320.520341:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642320.520639:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086454656 00000100:00100000:1.0:1788642320.520650:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086454656 00000100:00100000:1.0:1788642320.520716:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:1.0:1788642320.520728:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086454656:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788642320.520748:0:9442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642320.520768:0:9442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1ae9a29/0x4ae1ee156666ddb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a3a expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788642320.520802:0:9442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c8410, blocks: 0x1 00010000:00010000:1.0:1788642320.520823:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788642320.520828:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642320.520837:0:9442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ae9a29/0x4ae1ee156666ddb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a3a expref: 8 pid: 9442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.520875:0:9442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1ae9a29/0x4ae1ee156666ddb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a3a expref: 8 pid: 9442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.520889:0:9442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3ba000, rc 0) 00000100:00100000:1.0:1788642320.520947:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086454656:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 221us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642320.520954:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:3.0:1788642320.523398:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642320.523446:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086454912 00000100:00100000:3.0:1788642320.523460:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086454912 00000100:00100000:3.0:1788642320.523541:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 182 00000100:00100000:3.0:1788642320.523553:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:11536:x1875527086454912:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788642320.523678:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:11536:x1875527086454912:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 127us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642320.523687:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 182 00000100:00100000:0.0:1788642320.528644:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642320.528716:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086455040 00000100:00100000:2.0:1788642320.528725:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086455040 00000100:00100000:2.0:1788642320.528799:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:2.0:1788642320.528810:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:11536:x1875527086455040:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788642320.528829:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642320.528847:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a41 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.528878:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1ae9a29/0x4ae1ee156666ddb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a3a expref: 9 pid: 9442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.528887:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642320.528891:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642320.528897:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a41 expref: 9 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.528932:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1ae9a29/0x4ae1ee156666ddb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a3a expref: 9 pid: 9442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.528946:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1ae9a29/0x4ae1ee156666ddb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a3a expref: 9 pid: 9442 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642320.528974:0:6709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1875527107424640:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788642320.529067:0:6709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642320.532349:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642320.532404:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086455168 00000100:00100000:0.0:1788642320.532414:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086455168 00010000:00010000:0.0:1788642320.532455:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ae9a29/0x4ae1ee156666ddb5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a3a expref: 10 pid: 9442 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642320.532500:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 67 00000100:00100000:0.0:1788642320.532510:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:2360:x1875527086455168:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642320.532537:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642320.532563:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1ae9a29/0x4ae1ee156666ddb5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a3a expref: 10 pid: 9442 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.532577:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1ae9a29/0x4ae1ee156666ddb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a3a expref: 10 pid: 9442 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.532622:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642320.532626:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642320.532635:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a41 expref: 10 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.532645:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a41 expref: 10 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.532683:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a41 expref: 10 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642320.532698:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8dad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5846:1875527107424768:192.168.202.49@tcp:105: 00000100:00100000:0.0:1788642320.532798:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9a3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788642320.532868:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1ae9a29/0x4ae1ee156666ddb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a3a expref: 10 pid: 9442 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642320.532884:0:6709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1875527107424640:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642320.532912:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a41 expref: 9 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.532924:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1e00, rc 0) 00000100:00100000:2.0:1788642320.532956:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:11536:x1875527086455040:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 4149us (4320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642320.532964:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:2.0:1788642320.546707:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8dad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5846:1875527107424768:192.168.202.49@tcp:105: 00010000:00010000:2.0:1788642320.546737:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642320.546802:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086455168:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 14292us (14464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642320.546814:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 67 00000100:00100000:1.0:1788642320.552040:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642320.552307:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086455296 00000100:00100000:3.0:1788642320.552319:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086455296 00002000:00100000:3.0:1788642320.552392:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8dddfaa6e300 x1875527086455296/t0(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:521/0 lens 504/0 e 0 to 0 dl 1788642331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788642320.552405:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddfaa6e300 with x1875527086455296 ext(0->8) 00002000:00010000:3.0:1788642320.552411:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddfaa6e300 00000100:00100000:3.0:1788642320.552457:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:3.0:1788642320.552469:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086455296:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788642320.552947:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:2360:x1875527086455296:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 Request processed in 478us (914us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788642320.552956:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00002000:00100000:3.0:1788642320.552963:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8dddfaa6e300 x1875527086455296/t4294967314(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:521/0 lens 504/448 e 0 to 0 dl 1788642331 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788642320.552984:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddfaa6e300 with x1875527086455296 ext(0->8) 00002000:00010000:3.0:1788642320.552989:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddfaa6e300 00000100:00100000:0.0:1788642320.561223:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642320.561608:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086455424 00000100:00100000:3.0:1788642320.561618:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086455424 00000100:00100000:3.0:1788642320.561686:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 183 00000100:00100000:3.0:1788642320.561697:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:11536:x1875527086455424:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788642320.630477:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:11536:x1875527086455424:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 Request processed in 68644us (69125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642320.630498:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 183 00000001:00080000:2.0:1788642320.633772:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1788642320.633791:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:2.0:1788642320.633848:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:2.0:1788642320.633898:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1788642320.633915:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788642320.633944:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dddfaaf8600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788642320.633949:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dddc4cb4c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dddfaaf8180 00000020:00080000:2.0:1788642320.633952:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dddc4cb4800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dddc64b7400 00000020:00080000:2.0:1788642320.634014:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1788642320.634209:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107424896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788642320.634297:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788642320.634308:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788642320.634390:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107424896 00000100:00100000:1.0:1788642320.634397:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107424896 00000100:00100000:1.0:1788642320.634457:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788642320.634467:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107424896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788642320.634497:0:9442:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1788642320.634543:0:9442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c840c, atime: 0x6a9c840d, ctime: 0x6a9c840c, blocks: 0xb 00010000:00010000:1.0:1788642320.634552:0:9442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd956988/0x4ae1ee156666ddc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.634572:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=408s v=(0 0) 00010000:00010000:1.0:1788642320.634577:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642320.634585:0:9442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd956988/0x4ae1ee156666ddc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.634604:0:9442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd956988/0x4ae1ee156666ddc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.634623:0:9442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd956988/0x4ae1ee156666ddc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.634631:0:9442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd956988/0x4ae1ee156666ddc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.634652:0:9442:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788642320.635459:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107425024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788642320.635509:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642320.635575:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107425024 00000100:00100000:0.0:1788642320.635581:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107425024 00000100:00100000:0.0:1788642320.635622:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788642320.635629:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107425024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788642320.635767:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788642320.635782:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788642320 00002000:00010000:0.0:1788642320.635785:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788642320.635787:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788642320 -> 1788642320 00002000:00010000:0.0:1788642320.635789:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788642320.635832:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1875527107425024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 203us (323us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788642320.635840:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788642320.635862:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788642320.635894:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dddc4e37b80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1788642320.635900:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107425024:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788642320.636020:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642320.636030:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd956988/0x4ae1ee156666ddc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.636041:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bba00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642320.636046:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd956988/0x4ae1ee156666ddc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.636056:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd956988/0x4ae1ee156666ddc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.636075:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd956988/0x4ae1ee156666ddc3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.636084:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd956988/0x4ae1ee156666ddc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.636138:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642320.636140:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642320.636141:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642320.636441:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1875527107424896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1974us (2144us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788642320.636449:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:0.0:1788642320.636573:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dddfaa6fb80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788642320.636580:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107424896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788642320.643011:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642320.643150:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086455552 00000100:00100000:0.0:1788642320.643161:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086455552 00000100:00100000:0.0:1788642320.643217:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:0.0:1788642320.643226:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:2359:x1875527086455552:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788642320.761173:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:2359:x1875527086455552:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 Request processed in 117931us (118156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642320.761189:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 55 00000001:00080000:1.0:1788642320.761436:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1788642320.761455:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1788642320.761466:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1788642320.770083:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642320.770155:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086455808 00000100:00100000:0.0:1788642320.770167:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086455808 00000100:00100000:0.0:1788642320.770231:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 184 00000100:00100000:0.0:1788642320.770241:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:11536:x1875527086455808:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788642320.770297:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642320.770327:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab200/0x4ae1ee156666ddae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a33 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.770349:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ddde02b5700) 00010000:00010000:0.0:1788642320.770354:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642320.770387:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666ddca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.770419:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666ddca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.770430:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666ddca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788642320.770702:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2c47cc9 reply state 00000000fc764827 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666ddca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642320.770712:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788642320.770819:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:11536:x1875527086455808:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 578us (747us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788642320.770843:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 184 00010000:00010000:1.0:1788642320.791734:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666ddca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642320.791756:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:1.0:1788642320.791761:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666ddca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.791771:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666ddca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.791778:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5de00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642320.791783:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666ddca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.791792:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666ddca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642320.791798:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086455936 00000100:00100000:3.0:1788642320.791811:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086455936 00010000:00010000:1.0:1788642320.791823:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ddde02b5700) 00010000:00010000:1.0:1788642320.791827:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642320.791833:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666ddca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.791840:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666ddca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642320.791889:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00100000:1.0:1788642320.792976:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086455936:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788642320.793319:0:9442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788642320.793323:0:9442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788642320 -> 1788642319 00002000:00010000:1.0:1788642320.793326:0:9442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788642317 00002000:00010000:1.0:1788642320.793328:0:9442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788642320 -> 1788642319 00002000:00010000:1.0:1788642320.793330:0:9442:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788642320.793454:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2359:x1875527086455936:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 491us (1705us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788642320.795746:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00100000:1.0:1788642320.802647:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642320.810159:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086456192 00000100:00100000:2.0:1788642320.810176:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086456192 00000100:00100000:2.0:1788642320.810255:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 185 00000100:00100000:2.0:1788642320.810266:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:11536:x1875527086456192:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788642320.810337:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.810354:0:9441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666dd92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a25 expref: 18 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.810363:0:9441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.810398:0:9441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666dd92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a25 expref: 18 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.810411:0:9441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666dd92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a25 expref: 18 pid: 9441 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642320.810424:0:9441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff93100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9441:1875527107425152:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788642320.810541:0:9441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642320.824762:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642320.824907:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086456320 00000100:00100000:1.0:1788642320.824928:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086456320 00000100:00100000:0.0:1788642320.824930:0:9441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff93100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9441:1875527107425152:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642320.824972:0:9441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.824980:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666dd92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a25 expref: 19 pid: 9441 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642320.825028:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:1.0:1788642320.825041:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddde4e66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:2359:x1875527086456320:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642320.825071:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642320.825079:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666dd92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a25 expref: 19 pid: 9441 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.825093:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666dd92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a25 expref: 19 pid: 9441 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.825159:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666dd92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a25 expref: 19 pid: 9441 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.825180:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ddde02b5700) 00010000:00010000:1.0:1788642320.825185:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.825196:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.825204:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.825311:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642320.825367:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddde4e66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:2359:x1875527086456320:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 328us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642320.825376:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 68 00010000:00010000:0.0:1788642320.825465:0:9441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.825473:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.825542:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.825549:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.825555:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.825569:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642320.825574:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.825581:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.825592:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ddde02b5700) 00010000:00010000:0.0:1788642320.825595:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788642320.825599:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.825606:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0800/0x4ae1ee156666ddd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642320.825656:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+17:11536:x1875527086456192:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 Request processed in 15391us (23023us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788642320.825664:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 185 00000100:00100000:0.0:1788642320.830270:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642320.830464:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086456448 00000100:00100000:3.0:1788642320.830476:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086456448 00000100:00100000:3.0:1788642320.830559:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:3.0:1788642320.830571:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086456448:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788642320.830619:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.830640:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a41 expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.830649:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788642320.830654:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788642320.830659:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.830696:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a41 expref: 8 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.830726:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a41 expref: 8 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642320.830744:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7394700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6711:1875527107425280:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642320.830824:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddddc2c6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788642320.836798:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7394700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6711:1875527107425280:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642320.836815:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:3.0:1788642320.836846:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642320.837951:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086456576 00000100:00100000:2.0:1788642320.837966:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086456576 00010000:00010000:2.0:1788642320.838021:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a41 expref: 9 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642320.838125:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:2.0:1788642320.838135:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2359:x1875527086456576:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642320.838161:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642320.838186:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a41 expref: 9 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.838201:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a41 expref: 9 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.838228:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666ddbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a41 expref: 9 pid: 6709 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.838247:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788642320.838262:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788642320.838269:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.838279:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.838338:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642320.838408:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2359:x1875527086456576:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 273us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642320.838416:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 69 00010000:00010000:0.0:1788642320.838706:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.838717:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.838745:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.838766:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.838774:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.838781:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffab400 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642320.838786:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.838797:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.838810:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.838817:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055d10af5/0x4ae1ee156666ddd8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642320.838891:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086456448:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 Request processed in 8323us (8633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642320.838900:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:1.0:1788642320.844003:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642320.844074:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086456832 00000100:00100000:3.0:1788642320.844087:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086456832 00000100:00100000:3.0:1788642320.844268:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 186 00000100:00100000:3.0:1788642320.844279:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+17:11536:x1875527086456832:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788642320.844368:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dddf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.844385:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dddf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.844397:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dddf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.844603:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.844614:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dda0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a2c expref: 18 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.844639:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.844673:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dda0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a2c expref: 18 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.844686:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dda0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a2c expref: 18 pid: 9441 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642320.844700:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc7394700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107425408:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642320.844789:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddddc2c6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788642320.860528:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642320.860588:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc7394700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107425408:192.168.202.49@tcp:104: 00010000:00010000:3.0:1788642320.860621:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642320.860711:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086456960 00000100:00100000:2.0:1788642320.860719:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086456960 00010000:00010000:2.0:1788642320.860756:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dda0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a2c expref: 19 pid: 9441 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642320.860798:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:2.0:1788642320.860807:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:2360:x1875527086456960:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642320.860826:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642320.860834:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dda0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a2c expref: 19 pid: 9441 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.860847:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dda0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a2c expref: 19 pid: 9441 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.860869:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666dda0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a2c expref: 19 pid: 9441 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.860887:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ddde02b5700) 00010000:00010000:2.0:1788642320.860891:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.862089:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.862142:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.862178:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642320.862241:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:2360:x1875527086456960:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 1432us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642320.862251:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 70 00010000:00010000:1.0:1788642320.862589:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642320.862598:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788642320.862795:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788642320.862966:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788642320.863009:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788642320.863093:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddface4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1875527107425536:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788642320.863203:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642320.863236:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc72ec3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642320.863770:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107425536 00000100:00100000:2.0:1788642320.863782:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107425536 00000100:00100000:2.0:1788642320.863830:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788642320.863840:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5861:x1875527107425536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788642320.863937:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5861:x1875527107425536:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642320.863944:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788642320.864140:0:5861:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788642320.864145:0:5861:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dddc4e37b80, transno 4294967315 00000100:00100000:1.0:1788642320.864164:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddface4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1875527107425536:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788642320.865208:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788642320.865310:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef152300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1875527107425664:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788642320.865778:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642320.865813:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc72ec3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642320.865914:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107425664 00000100:00100000:2.0:1788642320.865921:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107425664 00000100:00100000:2.0:1788642320.865974:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788642320.865985:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddefface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5861:x1875527107425664:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788642320.866220:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddefface00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5861:x1875527107425664:12345-0@lo:1000:mdt00_000.0 Request processed in 236us (441us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788642320.866227:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788642320.866569:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef152300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5861:1875527107425664:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788642320.866625:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866636:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866644:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866650:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaa600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642320.866654:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866662:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866679:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ddde02b5700) 00010000:00010000:0.0:1788642320.866683:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788642320.866688:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866695:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa600/0x4ae1ee156666dde6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866731:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dd1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866738:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dd1b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866744:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dd1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866760:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642320.866763:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dd1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866769:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dd1b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866777:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9900) 00010000:00010000:0.0:1788642320.866780:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788642320.866783:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dd1b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866789:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666dd1b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866816:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866833:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a10 expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866844:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866883:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a10 expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.866906:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a10 expref: 21 pid: 5863 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642320.866932:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeffaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107425792:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642320.867023:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788642320.876249:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642320.876843:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeffaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107425792:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642320.876878:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642320.877925:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086457088 00000100:00100000:2.0:1788642320.877937:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086457088 00010000:00010000:2.0:1788642320.877988:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a10 expref: 22 pid: 5863 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642320.878043:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 71 00000100:00100000:2.0:1788642320.878079:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:2359:x1875527086457088:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642320.878137:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642320.878153:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a10 expref: 22 pid: 5863 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.878167:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a10 expref: 22 pid: 5863 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.878187:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0400/0x4ae1ee156666dd37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a10 expref: 22 pid: 5863 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.878207:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9900) 00010000:00010000:2.0:1788642320.878211:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.878222:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.878229:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642320.878268:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642320.878524:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:2359:x1875527086457088:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 446us (2284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642320.878532:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 71 00010000:00010000:3.0:1788642320.878623:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878633:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878646:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878653:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878659:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878673:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5cc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642320.878678:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878685:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878695:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9900) 00010000:00010000:3.0:1788642320.878698:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642320.878702:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878709:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5cc00/0x4ae1ee156666dded lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878720:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dddf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878725:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dddf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878731:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dddf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878735:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffab600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642320.878739:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dddf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878744:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dddf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878762:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dddc98d9900) 00010000:00010000:3.0:1788642320.878764:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788642320.878768:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dddf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.878774:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666dddf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642320.878989:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:11536:x1875527086456832:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 34711us (34996us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788642320.878997:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 186 00000020:00080000:3.0:1788642320.879001:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788642320.879250:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642320.879255:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642320.882242:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788642320.882263:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788642320.890524:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642320.890801:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086457344 00000100:00100000:2.0:1788642320.890816:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086457344 00000100:00100000:0.0:1788642320.890997:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:0.0:1788642320.891013:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddddbdc8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:11536:x1875527086457344:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788642320.891836:0:5865:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788642320.892557:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788642320.892635:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666ddf4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.892656:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666ddf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.892669:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666ddf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.892680:0:5865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666ddf4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.892687:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666ddf4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.892693:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666ddf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642320.892734:0:5865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788642320.893621:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642320.893632:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666ddf4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.893643:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:3.0:1788642320.893648:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666ddf4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.893656:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666ddf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.893671:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dddc2c20900) 00010000:00010000:3.0:1788642320.893674:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788642320.893679:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666ddf4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.893685:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c200/0x4ae1ee156666ddf4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642320.893727:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642320.893729:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642320.893731:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642320.894019:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddddbdc8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:11536:x1875527086457344:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 1880us (2388us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788642320.894033:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 50 00000020:00080000:0.0:1788642320.894040:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788642321.338523:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642322.072900:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642322.072947:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642322.072971:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642322.073005:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642322.073033:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642322.073041:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086457472 00000100:00100000:2.0:1788642322.073051:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086457472 00000100:00100000:3.0:1788642322.073056:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086457984 00000100:00100000:3.0:1788642322.073059:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086457984 00000100:00100000:3.0:1788642322.073113:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086457600 00000100:00100000:3.0:1788642322.073117:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086457600 00000100:00100000:2.0:1788642322.073122:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 298 00000100:00100000:2.0:1788642322.073131:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086457472:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642322.073139:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 164 00000100:00100000:3.0:1788642322.073145:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086457984:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642322.073216:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086457472:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 86us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642322.073224:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 298 00000100:00100000:3.0:1788642322.073441:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2360:x1875527086457984:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 290us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642322.073449:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 164 00000100:00100000:3.0:1788642322.073471:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 165 00000100:00100000:3.0:1788642322.073479:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:2360:x1875527086457600:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642322.073486:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086457728 00000100:00100000:0.0:1788642322.073490:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086457728 00000100:00100000:3.0:1788642322.073509:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:2360:x1875527086457600:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642322.073516:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 165 00000100:00100000:0.0:1788642322.073580:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086457856 00000100:00100000:3.0:1788642322.073582:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 95 00000100:00100000:0.0:1788642322.073583:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086457856 00000100:00100000:3.0:1788642322.073590:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086457728:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642322.073604:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00100000:0.0:1788642322.073610:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086457856:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642322.073624:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086457728:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 36us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642322.073631:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 95 00000100:00100000:0.0:1788642322.073631:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086457856:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 22us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642322.073636:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00080000:3.0:1788642322.073648:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788642322.073652:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788642322.073654:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788642322.357636:0:12538:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788642322.357647:0:12538:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788642322.357687:0:12538:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788642322.357694:0:12538:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788642322.368577:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642322.523556:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642322.523683:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086458240 00000100:00100000:3.0:1788642322.523702:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086458240 00000100:00100000:3.0:1788642322.523800:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 187 00000100:00100000:3.0:1788642322.523815:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:11554:x1875527086458240:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642322.523854:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642322.523893:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666ddfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a48 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.524050:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaba00/0x4ae1ee156666de02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.524069:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaba00/0x4ae1ee156666de02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.524085:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaba00/0x4ae1ee156666de02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642322.524145:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788642322.524321:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666ddfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a48 expref: 25 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.524347:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaba00/0x4ae1ee156666de02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a48 expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.524378:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:3.0:1788642322.524382:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788642322.524386:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaba00, rc 0) 00000100:00100000:3.0:1788642322.524483:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:11554:x1875527086458240:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 671us (942us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788642322.524491:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 187 00000100:00100000:3.0:1788642322.527366:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642322.527415:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086458368 00000100:00100000:3.0:1788642322.527425:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086458368 00000100:00100000:3.0:1788642322.527504:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 188 00000100:00100000:3.0:1788642322.527517:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:11554:x1875527086458368:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:3.0:1788642322.527608:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.527631:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.527648:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.527673:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.527682:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.527691:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528066:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528077:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528084:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788642322.528184:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528201:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528209:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528216:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528223:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaa400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642322.528228:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528238:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528256:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:3.0:1788642322.528260:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642322.528267:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528285:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528303:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528309:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528315:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528320:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffabc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642322.528323:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528329:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528336:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ddde02b5800) 00010000:00010000:3.0:1788642322.528338:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642322.528341:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528346:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528367:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528373:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528388:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528393:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaa000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642322.528396:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528403:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528411:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5900) 00010000:00010000:3.0:1788642322.528413:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642322.528416:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.528422:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642322.528538:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:11554:x1875527086458368:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 1021us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642322.528546:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 188 00000100:00100000:1.0:1788642322.568766:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642322.578155:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086458624 00000100:00100000:3.0:1788642322.578170:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086458624 00000100:00100000:3.0:1788642322.578253:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 189 00000100:00100000:3.0:1788642322.578264:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:11557:x1875527086458624:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642322.578284:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642322.578304:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a4f expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578390:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578405:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578418:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578445:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578453:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578461:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578714:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666de3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578725:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666de3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578733:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666de3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642322.578742:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788642322.578837:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578845:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578857:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578864:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffabc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642322.578868:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578876:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578888:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:3.0:1788642322.578891:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642322.578895:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578903:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666de2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578915:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578921:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578926:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578930:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaa400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642322.578933:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578949:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578957:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ddde02b5900) 00010000:00010000:3.0:1788642322.578959:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642322.578962:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.578969:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666de33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.579020:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666de25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a4f expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.579034:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666de3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a4f expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.579041:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:3.0:1788642322.579044:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642322.579046:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffab600, rc 0) 00000100:00100000:3.0:1788642322.579133:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef153800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:11557:x1875527086458624:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 870us (10379us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788642322.579143:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 189 00000100:00100000:1.0:1788642322.585449:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642322.587418:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086458752 00000100:00100000:3.0:1788642322.587443:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086458752 00000100:00100000:3.0:1788642322.587522:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 190 00000100:00100000:3.0:1788642322.587544:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:11557:x1875527086458752:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:3.0:1788642322.587635:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666de48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.587651:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666de48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.587662:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666de48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.587686:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666de48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.587692:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666de48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.587699:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666de48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.587704:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaae00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642322.587709:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666de48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.587717:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666de48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.587728:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:3.0:1788642322.587731:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788642322.587736:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666de48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642322.587744:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666de48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642322.587837:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef150000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:11557:x1875527086458752:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 304us (2408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642322.587845:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 190 00000100:00100000:2.0:1788642322.590448:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642322.593150:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086459008 00000100:00100000:0.0:1788642322.593166:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086459008 00000100:00100000:0.0:1788642322.593242:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:0.0:1788642322.593253:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:11557:x1875527086459008:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788642322.593530:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:11557:x1875527086459008:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 279us (3106us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788642322.593540:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:2.0:1788642322.625850:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642322.630673:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086459264 00000100:00100000:0.0:1788642322.630696:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086459264 00000100:00100000:0.0:1788642322.630803:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 191 00000100:00100000:0.0:1788642322.630816:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:11082:x1875527086459264:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788642322.630850:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642322.630880:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666de4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a56 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.631021:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.631039:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666de3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a4f expref: 28 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.631050:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.631438:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666de3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a4f expref: 28 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.631458:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666de3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a4f expref: 28 pid: 5862 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642322.631477:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeffaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107425920:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642322.631680:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642322.638842:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642322.638842:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeffaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107425920:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642322.638890:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642322.639284:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086459392 00000100:00100000:1.0:1788642322.639294:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086459392 00010000:00010000:1.0:1788642322.639347:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666de3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a4f expref: 29 pid: 5862 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642322.639388:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 72 00000100:00100000:1.0:1788642322.639400:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:2359:x1875527086459392:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642322.639421:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642322.639441:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666de3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a4f expref: 29 pid: 5862 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642322.639456:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666de3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a4f expref: 29 pid: 5862 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642322.639496:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666de3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a4f expref: 29 pid: 5862 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642322.639515:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:1.0:1788642322.639520:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642322.639533:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642322.639541:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642322.639572:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642322.639643:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:2359:x1875527086459392:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 245us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642322.639651:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 72 00010000:00010000:0.0:1788642322.639977:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.639986:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642322.640011:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788642322.640279:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666de4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a56 expref: 29 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.640302:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a56 expref: 28 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.640312:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:0.0:1788642322.640315:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788642322.640318:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5de00, rc 0) 00000100:00100000:0.0:1788642322.640367:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:11082:x1875527086459264:12345-192.168.202.49@tcp:101:bash.0 Request processed in 9554us (14532us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788642322.640375:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 191 00000100:00100000:2.0:1788642322.646388:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642322.646713:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086459648 00000100:00100000:0.0:1788642322.646728:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086459648 00000100:00100000:0.0:1788642322.646819:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 192 00000100:00100000:0.0:1788642322.646832:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:11082:x1875527086459648:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:0.0:1788642322.647239:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666de64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.647387:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666de64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.647420:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666de64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788642322.647503:0:9441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788642322.647535:0:9441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022bf971f reply state 000000001f1deb67 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666de64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642322.647548:0:9441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788642322.647603:0:9441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788642322.647751:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+32:11082:x1875527086459648:12345-192.168.202.49@tcp:36:bash.0 Request processed in 918us (1375us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788642322.647760:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 192 00000020:00080000:0.0:1788642322.647766:0:9441:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788642322.654454:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:0.0:1788642322.654562:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666de64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.654575:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666de64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.654582:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666de64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.654588:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642322.654593:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666de64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.654602:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666de64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.654618:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:0.0:1788642322.654634:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642322.654640:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666de64 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.654646:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d200/0x4ae1ee156666de64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642322.655665:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086459776 00000100:00100000:2.0:1788642322.655684:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086459776 00000100:00100000:2.0:1788642322.655785:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 193 00000100:00100000:2.0:1788642322.655797:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:11082:x1875527086459776:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788642322.655833:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642322.655862:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666de6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a5d expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.655944:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666de6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a5d expref: 32 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.655963:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666de6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a5d expref: 32 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.655986:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:2.0:1788642322.656003:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788642322.656008:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1800, rc 0) 00000100:00100000:2.0:1788642322.656121:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+32:11082:x1875527086459776:12345-192.168.202.49@tcp:101:bash.0 Request processed in 301us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642322.656131:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 193 00000100:00100000:0.0:1788642322.664070:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642322.664512:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086459904 00000100:00100000:1.0:1788642322.664526:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086459904 00000100:00100000:1.0:1788642322.664610:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:1.0:1788642322.664622:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:11082:x1875527086459904:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788642322.665895:0:9442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642322.665932:0:9442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046ce8a11/0x4ae1ee156666de72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a64 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788642322.665971:0:9442:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c840f, atime: 0x6a9c840d, ctime: 0x6a9c840f, blocks: 0xb 00010000:00010000:1.0:1788642322.666002:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:1.0:1788642322.666024:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642322.666036:0:9442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046ce8a11/0x4ae1ee156666de72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a64 expref: 8 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642322.666060:0:9442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046ce8a11/0x4ae1ee156666de72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a64 expref: 8 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642322.666076:0:9442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3bb400, rc 0) 00000100:00100000:1.0:1788642322.666515:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:11082:x1875527086459904:12345-192.168.202.49@tcp:101:bash.0 Request processed in 1892us (2449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642322.666526:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:3.0:1788642322.672694:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642322.674988:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086460032 00000100:00100000:0.0:1788642322.675004:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086460032 00002000:00010000:0.0:1788642322.675045:0:6716:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788642322.675049:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddf5296680 with x1875527086460032 ext(0->18446744073709551615) 00002000:00010000:0.0:1788642322.675059:0:6716:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddf5296680. 00000100:00100000:0.0:1788642322.675094:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:0.0:1788642322.675118:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086460032:12345-192.168.202.49@tcp:10:bash.0 00002000:00010000:0.0:1788642322.675377:0:6716:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788642322.675380:0:6716:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788642319 -> 1788642322 00002000:00010000:0.0:1788642322.675382:0:6716:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788642317 -> 1788642317 00002000:00010000:0.0:1788642322.675384:0:6716:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788642319 -> 1788642322 00002000:00010000:0.0:1788642322.675386:0:6716:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788642322.675460:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2360:x1875527086460032:12345-192.168.202.49@tcp:10:bash.0 Request processed in 342us (2774us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788642322.675467:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00002000:00010000:0.0:1788642322.675470:0:6716:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1788642322.675473:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddf5296680 with x1875527086460032 ext(0->18446744073709551615) 00002000:00010000:0.0:1788642322.675477:0:6716:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddf5296680. 00000100:00100000:2.0:1788642322.785832:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642322.785964:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086460160 00000100:00100000:0.0:1788642322.785978:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086460160 00000100:00100000:0.0:1788642322.786083:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 194 00000100:00100000:0.0:1788642322.786138:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc2f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+32:11572:x1875527086460160:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:0.0:1788642322.786252:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666de79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786277:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666de79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786293:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666de79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786314:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666de80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786322:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666de80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786330:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666de80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786667:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666de87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786677:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666de87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786685:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666de87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788642322.786738:0:9441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666de87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786754:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666de79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786767:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666de79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786775:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666de79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786782:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642322.786788:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666de79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786796:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666de79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786811:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:0.0:1788642322.786814:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642322.786820:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666de79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786828:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666de79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786844:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666de80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786850:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666de80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786857:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666de80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786862:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642322.786871:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666de80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786878:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666de80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786886:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc2c20f00) 00010000:00010000:0.0:1788642322.786889:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642322.786892:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666de80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786898:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c800/0x4ae1ee156666de80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786915:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666de87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786922:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666de87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786928:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666de87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786933:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5dc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642322.786936:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666de87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786942:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666de87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786949:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:0.0:1788642322.786951:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642322.786961:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666de87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.786967:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666de87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642322.787076:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc2f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+32:11572:x1875527086460160:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 980us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642322.787086:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 194 00000100:00100000:0.0:1788642322.879040:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642322.879230:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086460416 00000100:00100000:2.0:1788642322.879245:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086460416 00000100:00100000:2.0:1788642322.879329:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 195 00000100:00100000:2.0:1788642322.879341:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+32:11575:x1875527086460416:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642322.879374:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642322.879407:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666de8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a6b expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.879525:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666de95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.879545:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666de95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.879560:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666de95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.879579:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666de9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.879587:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666de9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.879594:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666de9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.880892:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666dea3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.880912:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666dea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.880923:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666dea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642322.880938:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788642322.881242:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666de95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881251:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666de95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881259:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666de95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881265:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642322.881270:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666de95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881279:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666de95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881294:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:2.0:1788642322.881297:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642322.881303:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666de95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881326:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666de95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881347:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666de9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881354:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666de9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881360:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666de9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881365:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642322.881368:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666de9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881374:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666de9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881381:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc98d9600) 00010000:00010000:2.0:1788642322.881384:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642322.881386:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666de9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881392:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666de9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881466:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666de8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a6b expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881484:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666dea3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a6b expref: 34 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.881499:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:2.0:1788642322.881501:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788642322.881504:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1600, rc 0) 00000100:00100000:2.0:1788642322.883119:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:11575:x1875527086460416:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 3752us (4076us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788642322.883133:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 195 00000100:00100000:3.0:1788642322.892336:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642322.892615:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086460544 00000100:00100000:0.0:1788642322.892626:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086460544 00000100:00100000:0.0:1788642322.892696:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 196 00000100:00100000:0.0:1788642322.892707:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:11575:x1875527086460544:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:0.0:1788642322.892783:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.892801:0:9441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a56 expref: 34 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.892811:0:9441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.892847:0:9441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a56 expref: 34 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.892861:0:9441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a56 expref: 34 pid: 5863 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642322.892875:0:9441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9441:1875527107426048:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642322.896350:0:9441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788642322.901017:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642322.901274:0:9441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9441:1875527107426048:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642322.901305:0:9441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642322.901483:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086460800 00000100:00100000:2.0:1788642322.901493:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086460800 00000100:00100000:2.0:1788642322.901561:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:2.0:1788642322.901572:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+35:5613:x1875527086460800:12345-192.168.202.49@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788642322.901934:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:5613:x1875527086460800:12345-192.168.202.49@tcp:35:ldlm_bl.0 Request processed in 363us (926us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788642322.901941:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:3.0:1788642322.909006:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642322.910274:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086460928 00000100:00100000:0.0:1788642322.910288:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086460928 00010000:00010000:0.0:1788642322.910336:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a56 expref: 36 pid: 5863 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642322.910489:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 73 00000100:00100000:0.0:1788642322.910500:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5297480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:2359:x1875527086460928:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642322.910517:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642322.910525:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a56 expref: 36 pid: 5863 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.910538:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a56 expref: 36 pid: 5863 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.910559:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666de56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a56 expref: 36 pid: 5863 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.910576:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:0.0:1788642322.910582:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.910592:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.910620:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.910664:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642322.910735:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5297480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+35:2359:x1875527086460928:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 237us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642322.910743:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 73 00010000:00010000:2.0:1788642322.910815:0:9441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.910824:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.910864:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.910872:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.910879:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.910896:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5dc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642322.910901:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.910909:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.910919:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:2.0:1788642322.910922:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788642322.910927:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642322.910933:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5dc00/0x4ae1ee156666deb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642322.910980:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:11575:x1875527086460544:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 18275us (18655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642322.910989:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 196 00000100:00100000:0.0:1788642322.914874:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642322.914961:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086461184 00000100:00100000:2.0:1788642322.914974:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086461184 00000100:00100000:2.0:1788642322.915047:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:2.0:1788642322.915068:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+34:11575:x1875527086461184:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788642322.915386:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+35:11575:x1875527086461184:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 328us (523us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788642322.915394:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 53 00000040:00080000:2.0:1788642322.938341:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642322.938351:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642322.938387:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788642322.938405:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788642322.995521:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642322.995783:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086461440 00000100:00100000:0.0:1788642322.995795:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086461440 00000100:00100000:0.0:1788642322.995856:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 197 00000100:00100000:0.0:1788642322.995865:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddf5297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+35:11586:x1875527086461440:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:0.0:1788642322.995887:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642322.995905:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666deb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a72 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.995963:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666debf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.995981:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666debf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.995990:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666debf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996003:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dec6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996014:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996035:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996314:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666decd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996321:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666decd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996327:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666decd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642322.996333:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788642322.996435:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666debf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996444:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666debf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996449:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666debf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996453:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642322.996456:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666debf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996461:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666debf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996470:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:0.0:1788642322.996473:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642322.996482:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666debf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996486:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666debf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996495:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996498:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dec6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996502:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dec6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996505:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642322.996506:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dec6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996509:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dec6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996513:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc2c20f00) 00010000:00010000:0.0:1788642322.996514:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642322.996516:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dec6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996519:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666dec6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996548:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666deb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a72 expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996567:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666decd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a72 expref: 37 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642322.996574:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:0.0:1788642322.996576:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788642322.996578:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5da00, rc 0) 00000100:00100000:0.0:1788642322.996639:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddf5297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:11586:x1875527086461440:12345-192.168.202.49@tcp:101:cat.0 Request processed in 775us (1126us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788642322.996646:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 197 00000100:00100000:3.0:1788642323.002031:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642323.002159:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086461696 00000100:00100000:2.0:1788642323.002169:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086461696 00000100:00100000:2.0:1788642323.002224:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 54 00000100:00100000:2.0:1788642323.002234:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:11586:x1875527086461696:12345-192.168.202.49@tcp:35:cat.0 00000100:00100000:2.0:1788642323.002499:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+38:11586:x1875527086461696:12345-192.168.202.49@tcp:35:cat.0 Request processed in 265us (477us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788642323.002509:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 54 00000100:00100000:1.0:1788642323.022553:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642323.022648:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086461952 00000100:00100000:3.0:1788642323.022659:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086461952 00000100:00100000:3.0:1788642323.022723:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 198 00000100:00100000:3.0:1788642323.022734:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+38:11587:x1875527086461952:12345-192.168.202.49@tcp:36:rm.0 00010000:00010000:3.0:1788642323.022795:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788642323.022822:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5da00/0x4ae1ee156666decd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a72 expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.022845:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666dea3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a6b expref: 37 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.022860:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666de6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a5d expref: 36 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.022871:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5800) 00010000:00010000:3.0:1788642323.022882:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642323.022919:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666dedb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.022936:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666dedb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.022945:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666dedb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.022960:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666dee2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.022966:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666dee2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.022974:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666dee2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.023415:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666dee9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.023425:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666dee9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.023433:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666dee9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788642323.023981:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788642323.023991:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410484891969ns, next at 411484889889ns, rc = 0 00010000:00010000:3.0:1788642323.024664:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666def0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024680:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666def0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024700:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666def0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024708:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666def0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024715:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666def0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024721:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666def0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024788:0:5861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788642323.024814:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666dee9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024822:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666dee9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024828:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666dee9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024834:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaa400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642323.024839:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666dee9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024847:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666dee9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024860:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5400) 00010000:00010000:3.0:1788642323.024863:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788642323.024872:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666dee9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024880:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666dee9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024898:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666dedb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024904:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666dedb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024909:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666dedb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024914:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaae00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642323.024917:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666dedb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024923:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666dedb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024930:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:3.0:1788642323.024932:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642323.024935:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666dedb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.024941:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666dedb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788642323.024950:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf572827 reply state 0000000087bc2f16 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666dee2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642323.024969:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788642323.025169:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+37:11587:x1875527086461952:12345-192.168.202.49@tcp:36:rm.0 Request processed in 2431us (2620us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788642323.025179:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 198 00010000:00010000:0.0:1788642323.032675:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642323.032690:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666def0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.032700:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffabc00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642323.032704:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666def0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.032714:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666def0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.032730:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ddde02b5400) 00010000:00010000:0.0:1788642323.032733:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788642323.032738:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666def0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.032745:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666def0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.032769:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642323.032787:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642323.032789:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642323.035418:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666dee2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.035437:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666dee2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.035445:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666dee2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.035451:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaa000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.035457:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666dee2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.035466:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666dee2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.035483:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ddde02b5900) 00010000:00010000:1.0:1788642323.035503:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642323.035509:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666dee2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.035516:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666dee2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642323.087343:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.088473:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086462208 00000100:00100000:0.0:1788642323.088484:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086462208 00000100:00100000:0.0:1788642323.088580:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 199 00000100:00100000:0.0:1788642323.088589:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+36:11593:x1875527086462208:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788642323.093511:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642323.093546:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666def7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a79 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.093679:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666defe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.093694:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666defe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.093705:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666defe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.093717:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666df05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.093722:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666df05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.093726:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666df05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788642323.094209:0:5863:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788642323.094334:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666df0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.094351:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666df0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.094356:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666df0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.094417:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666defe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.094425:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666defe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.094432:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666defe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.094438:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642323.094443:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666defe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.094451:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666defe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.094463:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:0.0:1788642323.094465:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642323.094469:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666defe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.094474:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666defe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788642323.094485:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1b812f0 reply state 00000000c0221c93 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666df05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642323.094496:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788642323.094524:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5de00/0x4ae1ee156666def7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a79 expref: 39 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.094536:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666df0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a79 expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.094541:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20300) 00010000:00010000:0.0:1788642323.094543:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788642323.094545:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5c000, rc 0) 00000100:00100000:0.0:1788642323.094970:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+39:11593:x1875527086462208:12345-192.168.202.49@tcp:101:bash.0 Request processed in 6062us (7315us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788642323.094979:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 199 00010000:00010000:0.0:1788642323.097835:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666df05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.097858:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666df05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.097866:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666df05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.097873:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642323.097878:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666df05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.097888:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666df05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.097935:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc2c20f00) 00010000:00010000:0.0:1788642323.097938:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642323.097945:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666df05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.097952:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c600/0x4ae1ee156666df05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642323.102685:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.102777:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086462336 00000100:00100000:0.0:1788642323.102788:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086462336 00000100:00100000:0.0:1788642323.102858:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:0.0:1788642323.102870:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2362:x1875527086462336:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788642323.102892:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642323.102913:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000271e7f31/0x4ae1ee156666df1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a80 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788642323.102942:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642323.102960:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1788642323.102965:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642323.102973:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000271e7f31/0x4ae1ee156666df1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a80 expref: 6 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.102992:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000271e7f31/0x4ae1ee156666df1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a80 expref: 6 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.103007:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5de00, rc 0) 00000100:00100000:0.0:1788642323.103079:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086462336:12345-192.168.202.49@tcp:101:bash.0 Request processed in 211us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642323.103094:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:3.0:1788642323.114432:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642323.115048:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086462464 00000100:00100000:2.0:1788642323.115059:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086462464 00000100:00100000:2.0:1788642323.115227:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:2.0:1788642323.115237:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef7dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:11593:x1875527086462464:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:2.0:1788642323.115255:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642323.115272:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a87 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.115306:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000271e7f31/0x4ae1ee156666df1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a80 expref: 7 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.115315:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642323.115320:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642323.115325:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.115363:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000271e7f31/0x4ae1ee156666df1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a80 expref: 7 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.115397:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000271e7f31/0x4ae1ee156666df1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a80 expref: 7 pid: 6711 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642323.115422:0:6709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6709:1875527107426176:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788642323.115527:0:6709:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788642323.120253:0:6709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6709:1875527107426176:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642323.120298:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.120320:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1000, rc 0) 00000100:00100000:2.0:1788642323.120414:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef7dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:11593:x1875527086462464:12345-192.168.202.49@tcp:101:bash.0 Request processed in 5169us (5985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642323.120424:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:0.0:1788642323.127509:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642323.127629:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086462592 00000100:00100000:2.0:1788642323.127640:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086462592 00010000:00010000:2.0:1788642323.127686:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000271e7f31/0x4ae1ee156666df1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a80 expref: 7 pid: 6711 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642323.127733:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 74 00000100:00100000:2.0:1788642323.127743:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086462592:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642323.127760:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642323.127785:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000271e7f31/0x4ae1ee156666df1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a80 expref: 7 pid: 6711 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.127821:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000271e7f31/0x4ae1ee156666df1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a80 expref: 7 pid: 6711 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.127846:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000271e7f31/0x4ae1ee156666df1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a80 expref: 7 pid: 6711 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.127862:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642323.127867:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642323.127875:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.127885:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.127923:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642323.127937:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5846:1875527107426304:192.168.202.49@tcp:105: 00000100:00100000:2.0:1788642323.128026:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788642323.131939:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddface4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107426688:0@lo:400:kworker.0 00000100:00100000:2.0:1788642323.132016:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642323.132076:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788642323.132085:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef9ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107426560:0@lo:400:kworker.0 00000100:00100000:2.0:1788642323.132133:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642323.132169:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb59ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107427072:0@lo:400:kworker.0 00000100:00100000:2.0:1788642323.132209:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642323.132242:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107427072 00000100:00100000:2.0:1788642323.132249:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107427072 00000100:00100000:2.0:1788642323.132304:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788642323.132313:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1875527107427072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642323.132360:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1875527107427072:12345-0@lo:400:kworker.0 Request processed in 49us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642323.132367:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788642323.132422:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb59ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107427072:0@lo:400:kworker.0 00000100:00100000:2.0:1788642323.132447:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107426688 00000100:00100000:2.0:1788642323.132451:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107426688 00000100:00100000:2.0:1788642323.132475:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107426560 00000100:00100000:2.0:1788642323.132477:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107426560 00000100:00100000:2.0:1788642323.132493:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788642323.132499:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107426688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642323.132530:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875527107426688:12345-0@lo:400:kworker.0 Request processed in 31us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642323.132537:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788642323.132547:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788642323.132552:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107426560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642323.132573:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107426560:12345-0@lo:400:kworker.0 Request processed in 21us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642323.132578:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788642323.132598:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef9ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107426560:0@lo:400:kworker.0 00000100:00100000:2.0:1788642323.132606:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddface4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1875527107426688:0@lo:400:kworker.0 00000100:00080000:3.0:1788642323.134400:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788642323.134422:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788642323.134923:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107426432:0@lo:400:kworker.0 00000100:00100000:1.0:1788642323.134994:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642323.135045:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107426944:0@lo:400:kworker.0 00000100:00100000:1.0:1788642323.135076:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642323.135125:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788642323.135133:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddf5296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107426816:0@lo:400:kworker.0 00000100:00100000:1.0:1788642323.135162:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642323.135209:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107426816 00000100:00100000:1.0:1788642323.135217:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107426816 00000100:00100000:1.0:1788642323.135273:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788642323.135282:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1875527107426816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642323.135334:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1875527107426816:12345-0@lo:400:kworker.0 Request processed in 52us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642323.135340:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788642323.135357:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642323.135382:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107426816:0@lo:400:kworker.0 00000100:00100000:1.0:1788642323.135421:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107426944 00000100:00100000:1.0:1788642323.135425:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107426944 00000100:00100000:1.0:1788642323.135456:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788642323.135476:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107426944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642323.135513:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107426944:12345-0@lo:400:kworker.0 Request processed in 38us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642323.135519:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1788642323.135533:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642323.135548:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddf5294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107426944:0@lo:400:kworker.0 00000100:00100000:3.0:1788642323.135932:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107426432 00000100:00100000:3.0:1788642323.135936:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107426432 00000100:00100000:3.0:1788642323.135969:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788642323.135976:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107426432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642323.136017:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107426432:12345-0@lo:400:kworker.0 Request processed in 42us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642323.136024:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788642323.136078:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107426432:0@lo:400:kworker.0 00000100:00100000:3.0:1788642323.138943:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5846:1875527107426304:192.168.202.49@tcp:105: 00010000:00010000:3.0:1788642323.138973:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642323.139037:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2360:x1875527086462592:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 11294us (11538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642323.139048:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 74 00000100:00100000:1.0:1788642323.145357:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.145459:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086462848 00000100:00100000:0.0:1788642323.145470:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086462848 00000100:00100000:0.0:1788642323.145532:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:0.0:1788642323.145542:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+38:11593:x1875527086462848:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:0.0:1788642323.145890:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+39:11593:x1875527086462848:12345-192.168.202.49@tcp:35:bash.0 Request processed in 348us (541us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788642323.145898:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 55 00000100:00100000:2.0:1788642323.356061:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642323.360586:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086462976 00000100:00100000:3.0:1788642323.360603:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086462976 00000100:00100000:3.0:1788642323.360689:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 200 00000100:00100000:3.0:1788642323.360700:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+39:11609:x1875527086462976:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642323.360727:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642323.360764:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666df28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a8e expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.360845:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666df2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.360861:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666df2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.360872:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666df2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642323.360908:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788642323.360912:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642323.360930:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666df2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.360956:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666df28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a8e expref: 41 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.360974:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666df2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a8e expref: 40 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.360983:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:3.0:1788642323.360985:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788642323.360989:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaae00, rc 0) 00000100:00100000:3.0:1788642323.361072:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+40:11609:x1875527086462976:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 373us (5022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642323.361079:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 200 00000100:00100000:2.0:1788642323.366560:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642323.366653:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086463232 00000100:00100000:1.0:1788642323.366663:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086463232 00000100:00100000:1.0:1788642323.366721:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 201 00000100:00100000:1.0:1788642323.366730:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+40:11609:x1875527086463232:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642323.366750:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642323.366768:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bba00/0x4ae1ee156666df36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a95 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.366871:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666df3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.366886:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666df3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.366897:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666df3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642323.366907:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788642323.367026:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bba00/0x4ae1ee156666df36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a95 expref: 43 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.367044:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666df3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a95 expref: 42 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.367068:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20300) 00010000:00010000:1.0:1788642323.367071:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642323.367076:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3ba400, rc 0) 00000100:00100000:1.0:1788642323.367436:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+42:11609:x1875527086463232:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 704us (882us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788642323.367443:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 201 00000100:00100000:0.0:1788642323.376628:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.376727:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642323.376945:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086463616 00000100:00100000:2.0:1788642323.376957:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086463616 00000100:00100000:2.0:1788642323.377034:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:2.0:1788642323.377045:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7e7f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+42:2360:x1875527086463616:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642323.377062:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642323.377091:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666df3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a95 expref: 42 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.377155:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20300) 00010000:00010000:2.0:1788642323.377161:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642323.377228:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7e7f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+41:2360:x1875527086463616:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 185us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642323.377236:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:3.0:1788642323.379564:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086463488 00000100:00100000:3.0:1788642323.379593:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086463488 00000100:00100000:3.0:1788642323.379732:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 202 00000100:00100000:3.0:1788642323.379741:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+41:11609:x1875527086463488:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642323.379769:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642323.379790:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666df4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9a9c expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.379887:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666df52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.379908:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666df52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.379920:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666df52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642323.379933:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788642323.380083:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666df4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a9c expref: 44 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.380135:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666df52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a9c expref: 43 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.380145:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20300) 00010000:00010000:3.0:1788642323.380148:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788642323.380151:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffab800, rc 0) 00000100:00100000:3.0:1788642323.380218:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+43:11609:x1875527086463488:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 477us (3601us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788642323.380225:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 202 00000100:00100000:0.0:1788642323.385418:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642323.385526:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086463744 00000100:00100000:2.0:1788642323.385539:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086463744 00000100:00100000:2.0:1788642323.385636:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:2.0:1788642323.385647:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+6:2362:x1875527086463744:12345-192.168.202.49@tcp:1:lfs.0 00010000:00010000:2.0:1788642323.385708:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.385733:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.385743:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642323.385772:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788642323.385778:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.385821:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 6 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.385834:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 6 pid: 6709 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642323.385849:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1875527107427200:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788642323.385964:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788642323.388855:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6711:1875527107427200:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642323.388897:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.389557:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642323.391508:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642323.391617:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086463872 00000100:00100000:1.0:1788642323.391628:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086463872 00002000:00100000:1.0:1788642323.391681:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8dddfd6ff480 x1875527086463872/t0(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:524/0 lens 504/0 e 0 to 0 dl 1788642334 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788642323.391693:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddfd6ff480 with x1875527086463872 ext(0->8) 00010000:00010000:1.0:1788642323.391704:0:6717:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 7 pid: 6709 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.391719:0:6717:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 7 pid: 6709 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788642323.391726:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dddfd6ff480 00000100:00100000:1.0:1788642323.391759:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:1.0:1788642323.391769:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086463872:12345-192.168.202.49@tcp:4:lfs.0 00000100:00100000:1.0:1788642323.392414:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2360:x1875527086463872:12345-192.168.202.49@tcp:4:lfs.0 Request processed in 643us (912us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788642323.392423:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00002000:00100000:1.0:1788642323.392432:0:6717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8dddfd6ff480 x1875527086463872/t4294967308(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:524/0 lens 504/448 e 0 to 0 dl 1788642334 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788642323.392446:0:6717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddfd6ff480 with x1875527086463872 ext(0->8) 00010000:00010000:1.0:1788642323.392453:0:6717:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 9 pid: 6709 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.392466:0:6717:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 9 pid: 6709 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788642323.392474:0:6717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dddfd6ff480 00000100:00100000:3.0:1788642323.395383:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642323.395522:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086464000 00000100:00100000:2.0:1788642323.395533:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086464000 00010000:00010000:2.0:1788642323.395570:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 9 pid: 6709 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642323.395608:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 75 00000100:00100000:2.0:1788642323.395618:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2359:x1875527086464000:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642323.395637:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788642323.395660:0:5846:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788642323.395662:0:5846:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788642323 00002000:00010000:2.0:1788642323.395678:0:5846:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788642323 00002000:00010000:2.0:1788642323.395680:0:5846:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788642323 00010000:00010000:2.0:1788642323.395686:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 9 pid: 6709 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.395697:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 9 pid: 6709 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.395719:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666df21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a87 expref: 9 pid: 6709 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.395735:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788642323.395738:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788642323.395743:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.395751:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.395778:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642323.395842:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2359:x1875527086464000:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 224us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642323.395849:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 75 00010000:00010000:0.0:1788642323.395883:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.395894:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.395918:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.395926:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.395933:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.395945:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642323.395949:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.395970:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.395983:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.395990:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4dd9ff8/0x4ae1ee156666df60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642323.396055:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2362:x1875527086463744:12345-192.168.202.49@tcp:1:lfs.0 Request processed in 10409us (10648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642323.396063:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:3.0:1788642323.398344:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.398397:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086464256 00000100:00100000:0.0:1788642323.398408:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086464256 00000100:00100000:0.0:1788642323.398471:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 56 00000100:00100000:0.0:1788642323.398481:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddddbdcb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+43:11609:x1875527086464256:12345-192.168.202.49@tcp:35:lfs.0 00000004:00010000:0.0:1788642323.398549:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666df52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a9c expref: 43 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788642323.398775:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788642323.398924:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788642323.399313:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788642323.399357:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.399372:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666df0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a79 expref: 47 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.399379:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.399534:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666df0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a79 expref: 47 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.399547:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666df0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a79 expref: 47 pid: 5863 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642323.399560:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1875527107427328:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642323.399652:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642323.402320:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.402320:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1875527107427328:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642323.402347:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642323.402424:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086464384 00000100:00100000:1.0:1788642323.402431:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086464384 00010000:00010000:1.0:1788642323.402466:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666df0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a79 expref: 48 pid: 5863 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642323.402500:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00100000:1.0:1788642323.402510:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+48:2359:x1875527086464384:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642323.402525:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642323.402532:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666df0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a79 expref: 48 pid: 5863 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.402542:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666df0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a79 expref: 48 pid: 5863 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.402558:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666df0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a79 expref: 48 pid: 5863 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.402570:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20300) 00010000:00010000:1.0:1788642323.402586:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.402594:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.402600:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.402621:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642323.402639:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.402646:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642323.402715:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+47:2359:x1875527086464384:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 206us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642323.402722:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 76 00000001:00080000:0.0:1788642323.402785:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788642323.403010:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788642323.403157:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875527107427456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788642323.403202:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642323.403286:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788642323.403872:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107427456 00000100:00100000:2.0:1788642323.403880:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107427456 00000100:00100000:2.0:1788642323.403924:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788642323.403935:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5864:x1875527107427456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788642323.404170:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5864:x1875527107427456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 236us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642323.404177:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788642323.404242:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875527107427456:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788642323.405033:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788642323.405204:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875527107427584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788642323.405252:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642323.405345:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788642323.405385:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107427584 00000100:00100000:3.0:1788642323.405399:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107427584 00000100:00100000:3.0:1788642323.405552:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788642323.405563:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5864:x1875527107427584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788642323.405780:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5864:x1875527107427584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 219us (527us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788642323.405787:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788642323.405922:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875527107427584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788642323.405989:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788642323.406026:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.406037:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.406045:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.406051:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642323.406056:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.406064:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.406079:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20300) 00010000:00010000:0.0:1788642323.406083:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788642323.406088:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.406134:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666df67 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788642323.406305:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788642323.406413:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788642323.406436:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410867337411ns, next at 411867334312ns, rc = 0 00000001:00080000:0.0:1788642323.406443:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788642323.406477:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20300) 00010000:00010000:0.0:1788642323.406481:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788642323.406489:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666df52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a9c expref: 51 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642323.406592:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddddbdcb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+50:11609:x1875527086464256:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 8111us (8255us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788642323.406602:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 56 00000020:00080000:0.0:1788642323.406606:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788642323.409381:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.409815:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086464512 00000100:00100000:0.0:1788642323.409828:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086464512 00000100:00100000:0.0:1788642323.409905:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 203 00000100:00100000:0.0:1788642323.409917:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+50:11609:x1875527086464512:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788642323.409944:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642323.409977:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666df6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9aa3 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.410050:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666df6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9aa3 expref: 51 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.410089:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666df6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9aa3 expref: 51 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.410139:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:0.0:1788642323.410142:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788642323.410145:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5ca00, rc 0) 00000100:00100000:0.0:1788642323.410224:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef151500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+51:11609:x1875527086464512:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 309us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642323.410232:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 203 00000100:00100000:1.0:1788642323.414147:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.414450:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086464768 00000100:00100000:0.0:1788642323.414462:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086464768 00000100:00100000:0.0:1788642323.414528:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:0.0:1788642323.414538:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+51:11609:x1875527086464768:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788642323.414785:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:11609:x1875527086464768:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 247us (645us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788642323.414805:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 57 00000100:00100000:3.0:1788642323.522956:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642323.523095:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086464896 00000100:00100000:1.0:1788642323.523140:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086464896 00000100:00100000:1.0:1788642323.523213:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 204 00000100:00100000:1.0:1788642323.523224:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:11619:x1875527086464896:12345-192.168.202.49@tcp:34:lfs.0 00010000:00010000:1.0:1788642323.523303:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523320:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523332:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523347:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523355:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523399:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523497:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523505:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523512:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788642323.523557:0:9441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523570:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523576:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523582:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523587:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3baa00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.523592:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523599:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523611:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:1.0:1788642323.523619:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642323.523625:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523631:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523645:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523651:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523656:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523662:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bbc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.523665:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523671:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523679:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc365fa00) 00010000:00010000:1.0:1788642323.523682:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642323.523685:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523691:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523711:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523724:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523729:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523735:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bae00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.523738:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523744:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523752:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642323.523754:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642323.523757:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.523762:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642323.523855:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:11619:x1875527086464896:12345-192.168.202.49@tcp:34:lfs.0 Request processed in 632us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642323.523864:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 204 00000100:00100000:3.0:1788642323.571591:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642323.571727:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086465152 00000100:00100000:1.0:1788642323.571739:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086465152 00000100:00100000:1.0:1788642323.571812:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 205 00000100:00100000:1.0:1788642323.571824:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+52:11622:x1875527086465152:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642323.571848:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642323.571886:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9aaa expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.571964:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.571980:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.571993:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572008:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572015:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572035:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572425:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb800/0x4ae1ee156666df9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572437:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb800/0x4ae1ee156666df9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572445:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb800/0x4ae1ee156666df9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642323.572457:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788642323.572584:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572603:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572610:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572616:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bbc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.572622:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572629:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572642:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:1.0:1788642323.572645:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642323.572649:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572655:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666df91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572668:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572674:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572679:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572684:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3baa00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.572692:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572698:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572706:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc365fa00) 00010000:00010000:1.0:1788642323.572708:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642323.572712:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572717:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666df98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572773:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bae00/0x4ae1ee156666df8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9aaa expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572789:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb800/0x4ae1ee156666df9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9aaa expref: 54 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.572797:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642323.572799:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642323.572802:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3bb800, rc 0) 00000100:00100000:1.0:1788642323.572882:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:11622:x1875527086465152:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1060us (1305us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788642323.572889:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 205 00000100:00100000:0.0:1788642323.576769:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642323.576859:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086465280 00000100:00100000:1.0:1788642323.576869:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086465280 00000100:00100000:1.0:1788642323.576927:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 206 00000100:00100000:1.0:1788642323.576938:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:11622:x1875527086465280:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:1.0:1788642323.577035:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.577054:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.577076:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.577151:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.577159:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.577166:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.577498:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.577503:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.577513:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.577528:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642323.577532:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788642323.577538:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.577545:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642323.577650:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:11622:x1875527086465280:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 712us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642323.577659:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 206 00000100:00100000:3.0:1788642323.582978:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.583195:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086465536 00000100:00100000:0.0:1788642323.583206:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086465536 00000100:00100000:0.0:1788642323.583266:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:0.0:1788642323.583277:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+54:11622:x1875527086465536:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788642323.583554:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:11622:x1875527086465536:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 278us (585us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788642323.583563:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 58 00000100:00100000:3.0:1788642323.642753:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642323.642780:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc3666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107427712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642323.642861:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642323.643201:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107427712 00000100:00100000:1.0:1788642323.643210:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107427712 00000100:00100000:1.0:1788642323.643268:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788642323.643278:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875527107427712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642323.643314:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642323.643648:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875527107427712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 371us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642323.643657:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788642323.648275:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc3666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107427712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642323.672540:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.672726:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086465792 00000100:00100000:0.0:1788642323.672739:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086465792 00000100:00100000:0.0:1788642323.672810:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 207 00000100:00100000:0.0:1788642323.672821:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:11632:x1875527086465792:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788642323.672847:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642323.672849:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788642323.672877:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666df2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a8e expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.672896:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:0.0:1788642323.672902:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642323.672917:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dfb4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9ab1 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.673023:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.673037:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb800/0x4ae1ee156666df9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9aaa expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.673045:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.673087:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb800/0x4ae1ee156666df9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9aaa expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.673152:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb800/0x4ae1ee156666df9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9aaa expref: 55 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642323.673189:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad19500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107427840:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642323.673296:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc3f9ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642323.679984:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.680234:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad19500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107427840:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642323.680262:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642323.680341:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086465920 00000100:00100000:2.0:1788642323.680348:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086465920 00010000:00010000:2.0:1788642323.680402:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb800/0x4ae1ee156666df9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9aaa expref: 56 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642323.680443:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00100000:2.0:1788642323.680452:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3665500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+56:2360:x1875527086465920:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642323.680470:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642323.680477:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb800/0x4ae1ee156666df9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9aaa expref: 56 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.680489:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb800/0x4ae1ee156666df9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9aaa expref: 56 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.680510:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb800/0x4ae1ee156666df9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9aaa expref: 56 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.680526:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:2.0:1788642323.680531:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.680541:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.680563:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.680598:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642323.680660:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3665500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:2360:x1875527086465920:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 208us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642323.680668:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 77 00010000:00010000:1.0:1788642323.681573:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.681585:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642323.681606:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788642323.681762:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5d000/0x4ae1ee156666dfb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab1 expref: 56 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.681783:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab1 expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.681793:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642323.681795:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788642323.681810:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5c000, rc 0) 00000100:00100000:1.0:1788642323.681869:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:11632:x1875527086465792:12345-192.168.202.49@tcp:101:bash.0 Request processed in 9050us (9339us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788642323.681877:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 207 00000100:00100000:1.0:1788642323.685847:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642323.685936:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086466176 00000100:00100000:3.0:1788642323.685946:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086466176 00000100:00100000:3.0:1788642323.686019:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 208 00000100:00100000:3.0:1788642323.686030:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+55:11632:x1875527086466176:12345-192.168.202.49@tcp:36:bash.0 00010000:00010000:3.0:1788642323.686348:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666dfc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.686387:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666dfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.686418:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666dfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788642323.686474:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788642323.686500:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc91ba8b reply state 0000000013b20fcb transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666dfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642323.686509:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788642323.686613:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+58:11632:x1875527086466176:12345-192.168.202.49@tcp:36:bash.0 Request processed in 585us (775us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788642323.686622:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 208 00000020:00080000:3.0:1788642323.686627:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788642323.688963:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666dfc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.688981:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666dfc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.688988:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666dfc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.688994:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaaa00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.688999:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666dfc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.689006:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666dfc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.689033:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642323.689037:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642323.689042:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666dfc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.689049:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666dfc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642323.693664:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642323.693831:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086466304 00000100:00100000:3.0:1788642323.693842:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086466304 00000100:00100000:3.0:1788642323.693938:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 209 00000100:00100000:3.0:1788642323.693951:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+57:11632:x1875527086466304:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:3.0:1788642323.693978:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642323.694002:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666dfd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9ab8 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.694125:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.694144:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab1 expref: 58 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.694153:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.694219:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab1 expref: 58 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.694233:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab1 expref: 58 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642323.694247:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad38000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107427968:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642323.694411:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b4000 going to sleep for 11 seconds 00000100:00100000:3.0:1788642323.698695:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.698775:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086466432 00000100:00100000:0.0:1788642323.698785:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086466432 00010000:00010000:0.0:1788642323.698826:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab1 expref: 59 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642323.698869:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 78 00000100:00100000:0.0:1788642323.698879:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:2359:x1875527086466432:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642323.698893:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642323.698900:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab1 expref: 59 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.698912:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab1 expref: 59 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.698934:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:0.0:1788642323.698938:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.698948:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.698973:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.698992:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642323.699066:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:2359:x1875527086466432:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 180us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642323.699073:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 78 00010000:00010000:1.0:1788642323.701610:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c000/0x4ae1ee156666dfbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab1 expref: 58 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642323.701654:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad38000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875527107427968:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642323.701681:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.701692:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.701698:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642323.701748:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788642323.701753:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642323.701774:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.701811:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666dfd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab8 expref: 58 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.701827:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab8 expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.701836:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642323.701839:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642323.701842:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaa800, rc 0) 00000100:00100000:1.0:1788642323.701975:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+57:11632:x1875527086466304:12345-192.168.202.49@tcp:101:bash.0 Request processed in 8027us (8322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642323.701984:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 209 00000100:00100000:3.0:1788642323.706320:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.706504:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086466688 00000100:00100000:0.0:1788642323.706514:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086466688 00000100:00100000:0.0:1788642323.706618:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:0.0:1788642323.706630:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+57:11632:x1875527086466688:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:0.0:1788642323.706876:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+58:11632:x1875527086466688:12345-192.168.202.49@tcp:35:bash.0 Request processed in 247us (566us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788642323.706884:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 59 00000100:00100000:2.0:1788642323.792940:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642323.793041:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086466816 00000100:00100000:3.0:1788642323.793052:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086466816 00000100:00100000:1.0:1788642323.793350:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 210 00000100:00100000:1.0:1788642323.793403:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfacf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+58:11638:x1875527086466816:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642323.793428:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642323.793448:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9abf expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.793513:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dfe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.793528:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.793542:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642323.793579:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788642323.793582:0:9441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642323.793602:0:9441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.793624:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9abf expref: 60 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.793644:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dfe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9abf expref: 59 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.793652:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:1.0:1788642323.793655:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788642323.793658:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3baa00, rc 0) 00000100:00100000:1.0:1788642323.793725:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfacf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:11638:x1875527086466816:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 355us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642323.793746:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 210 00000100:00100000:3.0:1788642323.798991:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642323.799239:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086466944 00000100:00100000:1.0:1788642323.799250:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086466944 00000100:00100000:1.0:1788642323.799309:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 211 00000100:00100000:1.0:1788642323.799319:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:11638:x1875527086466944:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642323.799341:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642323.799379:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9ac6 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799442:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dff3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799458:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799468:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799482:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dffa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799490:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799497:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799578:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bba00/0x4ae1ee156666e001 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799602:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bba00/0x4ae1ee156666e001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799609:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bba00/0x4ae1ee156666e001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642323.799647:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788642323.799651:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642323.799668:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bba00/0x4ae1ee156666e001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799679:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bba00/0x4ae1ee156666e001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799688:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dff3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799694:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dff3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799701:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799708:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bbc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.799712:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799719:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dff3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799731:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:1.0:1788642323.799734:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642323.799743:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dff3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799750:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666dff3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799761:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799768:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dffa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799774:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799780:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.799783:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799790:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dffa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799797:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dddc365fa00) 00010000:00010000:1.0:1788642323.799799:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642323.799801:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dffa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799807:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666dffa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799842:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666dfec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ac6 expref: 61 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799869:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bba00/0x4ae1ee156666e001 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ac6 expref: 60 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.799876:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642323.799878:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642323.799880:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3bba00, rc 0) 00000100:00100000:1.0:1788642323.799942:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:11638:x1875527086466944:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 624us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642323.799949:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 211 00000100:00100000:2.0:1788642323.814918:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642323.815049:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642323.815587:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086467328 00000100:00100000:0.0:1788642323.815597:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086467328 00000100:00100000:0.0:1788642323.815671:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:0.0:1788642323.815682:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:2362:x1875527086467328:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642323.815698:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642323.815724:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bba00/0x4ae1ee156666e001 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ac6 expref: 60 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642323.815744:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:0.0:1788642323.815750:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642323.815812:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:2362:x1875527086467328:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 133us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642323.815840:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:1.0:1788642323.817967:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086467200 00000100:00100000:1.0:1788642323.817983:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086467200 00000100:00100000:1.0:1788642323.818429:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 212 00000100:00100000:1.0:1788642323.818441:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:11638:x1875527086467200:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642323.818465:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642323.818489:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e008 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9acd expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.818608:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.818624:0:9441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab8 expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.818633:0:9441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.818670:0:9441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab8 expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.818697:0:9441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab8 expref: 60 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642323.818710:0:9441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc3666680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9441:1875527107428096:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642323.818812:0:9441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0b0d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788642323.823226:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642323.823419:0:9441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc3666680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9441:1875527107428096:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642323.823448:0:9441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642323.823583:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086467456 00000100:00100000:3.0:1788642323.823591:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086467456 00010000:00010000:3.0:1788642323.823632:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab8 expref: 61 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642323.823673:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:3.0:1788642323.823683:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:2360:x1875527086467456:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642323.823697:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642323.823704:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab8 expref: 61 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.823714:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab8 expref: 61 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.823754:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666dfd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ab8 expref: 61 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.823767:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:3.0:1788642323.823772:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.823781:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.823788:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.823816:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642323.823869:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:2360:x1875527086467456:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 187us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642323.823876:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 79 00010000:00010000:1.0:1788642323.824042:0:9441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.824051:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642323.824074:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788642323.824284:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e008 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9acd expref: 61 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.824300:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9acd expref: 60 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.824308:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642323.824311:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788642323.824314:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3ba800, rc 0) 00000100:00100000:1.0:1788642323.824346:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:11638:x1875527086467200:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 5908us (9442us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788642323.824538:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 212 00000100:00100000:0.0:1788642323.830339:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642323.830511:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086467712 00000100:00100000:2.0:1788642323.830523:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086467712 00000100:00100000:2.0:1788642323.830592:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:2.0:1788642323.830602:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7e7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:11638:x1875527086467712:12345-192.168.202.49@tcp:103:lfs.0 00010000:00010000:2.0:1788642323.830620:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642323.830643:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ca00/0x4ae1ee156666df6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9aa3 expref: 60 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642323.830661:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:2.0:1788642323.830666:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642323.830725:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7e7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:11638:x1875527086467712:12345-192.168.202.49@tcp:103:lfs.0 Request processed in 124us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642323.830732:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:3.0:1788642323.833950:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642323.834048:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086467840 00000100:00100000:1.0:1788642323.834069:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086467840 00000100:00100000:1.0:1788642323.834161:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 213 00000100:00100000:1.0:1788642323.834172:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:11638:x1875527086467840:12345-192.168.202.49@tcp:58:lfs.0 00010000:00010000:1.0:1788642323.834291:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e01d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.834309:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e01d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.834320:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e01d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788642323.834649:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788642323.834731:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:11638:x1875527086467840:12345-192.168.202.49@tcp:58:lfs.0 Request processed in 560us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642323.834739:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 213 00000100:00100000:0.0:1788642323.840479:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642323.840684:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086467968 00000100:00100000:3.0:1788642323.840695:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086467968 00000100:00100000:3.0:1788642323.840761:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 214 00000100:00100000:3.0:1788642323.840773:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+59:11638:x1875527086467968:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642323.840795:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642323.840816:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666e024 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9ad4 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.840874:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e01d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.840900:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666e024 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ad4 expref: 60 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.840918:0:5861:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e01d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.840932:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666e024 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ad4 expref: 60 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.840946:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:3.0:1788642323.840949:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788642323.840952:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666e024 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ad4 expref: 60 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642323.840960:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaa800, rc 0) 00000100:00100000:3.0:1788642323.841747:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:11638:x1875527086467968:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 972us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642323.841756:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 214 00000040:00080000:2.0:1788642323.963483:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642323.963494:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642323.963557:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788642323.963564:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788642323.963709:0:11714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddface7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11714:1875527107428224:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788642323.963866:0:11714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788642323.978179:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642323.978488:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086468096 00000100:00100000:1.0:1788642323.978498:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086468096 00000100:00100000:1.0:1788642323.978562:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 215 00000100:00100000:1.0:1788642323.978572:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:11639:x1875527086468096:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788642323.978602:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788642323.978697:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:11639:x1875527086468096:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 126us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642323.978705:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 215 00000100:00100000:2.0:1788642323.980090:0:11714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddface7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11714:1875527107428224:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788642323.997424:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642323.997607:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086468224 00000100:00100000:1.0:1788642323.997628:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086468224 00000100:00100000:1.0:1788642323.997684:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 216 00000100:00100000:1.0:1788642323.997695:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:11639:x1875527086468224:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788642323.997777:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e02b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.997795:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e02b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.997807:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e02b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.997840:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e032 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.997849:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e032 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.997856:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e032 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.997882:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e039 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.997891:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.997898:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642323.997937:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788642323.997942:0:9441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642323.997962:0:9441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.997973:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e02b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.997981:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e02b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.997988:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e02b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998008:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bbc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.998012:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e02b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998020:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e02b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998032:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365f900) 00010000:00010000:1.0:1788642323.998035:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642323.998040:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e02b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998047:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e02b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998060:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e032 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998067:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e032 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998073:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e032 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998087:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.998090:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e032 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998164:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e032 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998173:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8dddc365fa00) 00010000:00010000:1.0:1788642323.998175:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642323.998178:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e032 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998183:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e032 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998204:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998211:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e039 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998216:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e039 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998222:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642323.998225:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e039 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998232:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e039 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998252:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642323.998255:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642323.998259:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e039 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642323.998265:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e039 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642323.998340:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:11639:x1875527086468224:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 Request processed in 644us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642323.998369:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 216 00000100:00100000:2.0:1788642324.004740:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.004825:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086468480 00000100:00100000:1.0:1788642324.004835:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086468480 00000100:00100000:1.0:1788642324.004911:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 217 00000100:00100000:1.0:1788642324.004931:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+60:11639:x1875527086468480:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788642324.004953:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642324.004975:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e040 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9adb expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.005090:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e047 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.005141:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.005310:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642324.005323:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788642324.005480:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.005489:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e047 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.005496:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e047 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.005501:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bb200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642324.005506:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e047 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.005514:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e047 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.005527:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642324.005530:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788642324.005535:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e047 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.005541:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e047 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.005588:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e040 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9adb expref: 62 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.005597:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365f900) 00010000:00010000:1.0:1788642324.005599:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788642324.005603:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e040 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9adb expref: 62 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.005622:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3bbc00, rc 0) 00000100:00100000:1.0:1788642324.005679:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:11639:x1875527086468480:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 759us (950us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788642324.005687:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 217 00000100:00080000:2.0:1788642324.005816:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642324.012416:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.012498:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086468608 00000100:00100000:1.0:1788642324.012507:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086468608 00000100:00100000:1.0:1788642324.012894:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 218 00000100:00100000:1.0:1788642324.012904:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:11639:x1875527086468608:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788642324.012941:0:9441:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788642324.013042:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:11639:x1875527086468608:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 139us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642324.013051:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 218 00000100:00100000:3.0:1788642324.020024:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.020147:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086468864 00000100:00100000:1.0:1788642324.020158:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086468864 00000100:00100000:1.0:1788642324.020224:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 219 00000100:00100000:1.0:1788642324.020234:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:11639:x1875527086468864:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788642324.020256:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642324.020260:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788642324.020292:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666dfe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9abf expref: 61 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.020313:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:1.0:1788642324.020318:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788642324.020332:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e055 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9ae2 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788642324.020966:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788642324.021407:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e05c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.021422:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e05c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.021432:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e05c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.021484:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e055 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ae2 expref: 63 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.021500:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e05c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ae2 expref: 62 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.021510:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc365fa00) 00010000:00010000:1.0:1788642324.021512:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788642324.021515:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3bb200, rc 0) 00000100:00100000:1.0:1788642324.021815:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+62:11639:x1875527086468864:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 1581us (2061us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788642324.021823:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 219 00000100:00100000:2.0:1788642324.030401:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642324.030530:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086469120 00000100:00100000:3.0:1788642324.030541:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086469120 00000100:00100000:3.0:1788642324.030598:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 220 00000100:00100000:3.0:1788642324.030607:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddface4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+62:11639:x1875527086469120:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788642324.030660:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642324.030683:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e05c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ae2 expref: 62 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030719:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc365fa00) 00010000:00010000:3.0:1788642324.030734:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642324.030754:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e06a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030767:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e06a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030777:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e06a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030790:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e071 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x21a30309 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030797:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e071 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x21a30309 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030803:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e071 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x21a30309 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030860:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e06a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030867:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e06a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030873:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e06a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030879:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffab800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642324.030883:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e06a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030895:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e06a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030903:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:3.0:1788642324.030906:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642324.030910:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e06a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030916:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e06a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030937:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e071 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x21a30309 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030943:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e071 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x21a30309 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030949:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e071 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x21a30309 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030954:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaae00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642324.030956:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e071 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x21a30309 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030961:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e071 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x21a30309 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030968:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x21a30309 (ffff8ddde02b5800) 00010000:00010000:3.0:1788642324.030970:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642324.030973:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e071 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x21a30309 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.030987:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e071 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x21a30309 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642324.031069:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddface4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:11639:x1875527086469120:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 462us (679us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788642324.031076:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 220 00000100:00100000:0.0:1788642324.036793:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.036945:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086469248 00000100:00100000:1.0:1788642324.036958:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086469248 00000100:00100000:1.0:1788642324.037068:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 221 00000100:00100000:1.0:1788642324.037079:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+61:11639:x1875527086469248:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788642324.037149:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642324.037195:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e078 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9ae9 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.037231:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666e07f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.037244:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666e07f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.037264:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666e07f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.037372:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e078 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ae9 expref: 63 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.037392:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666e07f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ae9 expref: 62 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.037401:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:1.0:1788642324.037404:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788642324.037408:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3baa00, rc 0) 00000100:00100000:1.0:1788642324.037486:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+62:11639:x1875527086469248:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 409us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642324.037493:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 221 00000100:00100000:0.0:1788642324.045842:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.045953:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086469504 00000100:00100000:1.0:1788642324.045963:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086469504 00000100:00100000:1.0:1788642324.046016:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 222 00000100:00100000:1.0:1788642324.046025:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+62:11639:x1875527086469504:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788642324.046178:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e086 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.046204:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.046217:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788642324.046477:0:9441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1788642324.046486:0:9441:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 411507387253ns, next at 412507384805ns, rc = 0 00000004:00010000:1.0:1788642324.046577:0:9441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f5a57cf reply state 00000000d2374284 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642324.046588:0:9441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788642324.046684:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+64:11639:x1875527086469504:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 658us (852us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788642324.046691:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 222 00000100:00100000:2.0:1788642324.055446:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:0.0:1788642324.055619:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.055632:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e086 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.055639:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.055645:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bbc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642324.055649:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.055656:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e086 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.055673:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:0.0:1788642324.055676:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788642324.055681:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e086 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.055705:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbc00/0x4ae1ee156666e086 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642324.061322:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086469632 00000100:00100000:3.0:1788642324.061339:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086469632 00000100:00100000:3.0:1788642324.061428:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 223 00000100:00100000:3.0:1788642324.061438:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+63:11639:x1875527086469632:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788642324.061465:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642324.061486:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e08d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9af0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.061553:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e08d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9af0 expref: 64 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.061567:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e08d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9af0 expref: 64 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.061587:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:3.0:1788642324.061591:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788642324.061594:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaae00, rc 0) 00000100:00100000:3.0:1788642324.061666:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+64:11639:x1875527086469632:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 229us (6229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642324.061673:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 223 00000100:00100000:0.0:1788642324.065304:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.065400:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086469760 00000100:00100000:1.0:1788642324.065412:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086469760 00000100:00100000:1.0:1788642324.065498:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:1.0:1788642324.065509:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2359:x1875527086469760:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788642324.065805:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:2359:x1875527086469760:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 297us (510us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788642324.065813:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00080000:2.0:1788642324.065890:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788642324.068734:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642324.068826:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086470016 00000100:00100000:2.0:1788642324.068835:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086470016 00000100:00100000:2.0:1788642324.068890:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:2.0:1788642324.068900:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+64:11639:x1875527086470016:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788642324.069164:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+65:11639:x1875527086470016:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 264us (438us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788642324.069172:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 60 00000100:00100000:0.0:1788642324.071825:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.071928:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086470272 00000100:00100000:1.0:1788642324.071936:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086470272 00000100:00100000:1.0:1788642324.071991:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 224 00000100:00100000:1.0:1788642324.072001:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+65:11639:x1875527086470272:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788642324.072149:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+65:11639:x1875527086470272:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 148us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642324.072173:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 224 00000100:00100000:3.0:1788642324.076634:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.077074:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086470400 00000100:00100000:1.0:1788642324.077084:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086470400 00000100:00100000:1.0:1788642324.077178:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 225 00000100:00100000:1.0:1788642324.077187:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+65:11639:x1875527086470400:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788642324.077206:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642324.077227:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e094 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9af7 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.077295:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e09b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.077309:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.077320:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642324.077355:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642324.077383:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.077409:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e094 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9af7 expref: 67 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.077426:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e09b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9af7 expref: 66 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.077434:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:1.0:1788642324.077450:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788642324.077454:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3ba400, rc 0) 00000100:00100000:1.0:1788642324.077522:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+66:11639:x1875527086470400:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 336us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642324.077538:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 225 00000100:00100000:0.0:1788642324.087542:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642324.087695:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086470528 00000100:00100000:2.0:1788642324.087706:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086470528 00000100:00100000:2.0:1788642324.087766:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:2.0:1788642324.087776:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+10:2359:x1875527086470528:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788642324.087796:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642324.087816:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e0a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9afe expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788642324.087843:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c8414, blocks: 0x1 00010000:00010000:2.0:1788642324.087863:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1788642324.087867:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642324.087889:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e0a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9afe expref: 11 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.087909:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e0a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9afe expref: 11 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.087922:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1e00, rc 0) 00000100:00100000:2.0:1788642324.087980:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+11:2359:x1875527086470528:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 205us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642324.087987:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:2.0:1788642324.106531:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.106830:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086470784 00000100:00100000:1.0:1788642324.106842:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086470784 00000100:00100000:1.0:1788642324.106906:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 226 00000100:00100000:1.0:1788642324.106927:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef9ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+66:11639:x1875527086470784:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788642324.107196:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef9ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+66:11639:x1875527086470784:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 280us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642324.107204:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 226 00000100:00100000:3.0:1788642324.110517:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.110671:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086470912 00000100:00100000:1.0:1788642324.110681:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086470912 00000100:00100000:1.0:1788642324.110736:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:1.0:1788642324.110746:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+11:11639:x1875527086470912:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788642324.110778:0:9442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642324.110797:0:9442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9b05 expref: -99 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.110829:0:9442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e0a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9afe expref: 12 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.110838:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642324.110842:0:9442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642324.110847:0:9442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b05 expref: 12 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.110892:0:9442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e0a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9afe expref: 12 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.110907:0:9442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e0a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9afe expref: 12 pid: 6712 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642324.110934:0:9442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc3666680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9442:1875527107428352:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642324.111580:0:9442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc7038e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788642324.117444:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642324.117590:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086471040 00000100:00100000:2.0:1788642324.117601:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086471040 00010000:00010000:2.0:1788642324.117647:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e0a2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9afe expref: 13 pid: 6712 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642324.117689:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:2.0:1788642324.117698:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:2360:x1875527086471040:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642324.117718:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642324.117742:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e0a2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9afe expref: 13 pid: 6712 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.117756:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e0a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9afe expref: 13 pid: 6712 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.117781:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642324.117801:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642324.117813:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b05 expref: 13 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.117824:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b05 expref: 13 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.117868:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b05 expref: 13 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.117882:0:9442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e0a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9afe expref: 13 pid: 6712 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642324.117887:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb59ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5847:1875527107428480:192.168.202.49@tcp:105: 00000100:00100000:1.0:1788642324.117909:0:9442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc3666680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9442:1875527107428352:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788642324.117995:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5240 going to sleep for 11 seconds 00010000:00010000:1.0:1788642324.118074:0:9442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b05 expref: 12 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.118085:0:9442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3ba600, rc 0) 00000100:00100000:1.0:1788642324.118149:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+12:11639:x1875527086470912:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 7404us (7644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642324.118156:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:0.0:1788642324.123413:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb59ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5847:1875527107428480:192.168.202.49@tcp:105: 00010000:00010000:0.0:1788642324.123441:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642324.123505:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+11:2360:x1875527086471040:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 5808us (6072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642324.123516:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:3.0:1788642324.126825:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642324.127079:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086471168 00000100:00100000:0.0:1788642324.127088:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086471168 00002000:00100000:0.0:1788642324.127167:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8dddfad39c00 x1875527086471168/t0(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:525/0 lens 504/0 e 0 to 0 dl 1788642335 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788642324.127178:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddfad39c00 with x1875527086471168 ext(0->12) 00002000:00010000:0.0:1788642324.127184:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddfad39c00 00000100:00100000:0.0:1788642324.127217:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:0.0:1788642324.127225:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+11:2360:x1875527086471168:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788642324.127819:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:2360:x1875527086471168:12345-192.168.202.49@tcp:4:lhsmtool_posix.0 Request processed in 592us (1000us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788642324.127827:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00002000:00100000:0.0:1788642324.127836:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8dddfad39c00 x1875527086471168/t4294967320(0) o4->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:525/0 lens 504/448 e 0 to 0 dl 1788642335 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788642324.127850:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddfad39c00 with x1875527086471168 ext(0->12) 00002000:00010000:0.0:1788642324.127854:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddfad39c00 00000100:00100000:3.0:1788642324.136997:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.137197:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086471296 00000100:00100000:1.0:1788642324.137207:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086471296 00000100:00100000:1.0:1788642324.137272:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 227 00000100:00100000:1.0:1788642324.137281:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+66:11639:x1875527086471296:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788642324.216372:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000004:00080000:0.0:1788642324.216397:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788642324.216412:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dddc3f9a000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788642324.216418:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dddd0b54700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dddc3f9ac00 00000020:00080000:0.0:1788642324.216421:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dddd0b54400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dddfaece400 00000001:00080000:0.0:1788642324.216465:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1788642324.216470:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:0.0:1788642324.216500:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dddc734d840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788642324.216503:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dddc5dcbc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dddc734d480 00000020:00080000:0.0:1788642324.216506:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dddc5dcb900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ddcc4a46000 00000001:00080000:0.0:1788642324.216519:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1788642324.216533:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1788642324.216543:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788642324.216561:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788642324.216744:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788642324.216864:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107428736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788642324.216933:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642324.217008:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788642324.217015:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107428608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788642324.217038:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642324.217067:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107428736 00000100:00100000:0.0:1788642324.217075:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107428736 00000100:00100000:0.0:1788642324.217146:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107428608 00000100:00100000:0.0:1788642324.217164:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107428608 00000100:00100000:0.0:1788642324.217189:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788642324.217197:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1875527107428736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788642324.217333:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788642324.217337:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788642324 00002000:00010000:0.0:1788642324.217339:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788642324.217341:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788642324 -> 1788642324 00002000:00010000:0.0:1788642324.217343:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788642324.217391:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3318:x1875527107428736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 194us (458us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788642324.217399:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788642324.217416:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788642324.217422:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1875527107428608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788642324.217438:0:6711:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788642324.217455:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.217476:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046ce8a11/0x4ae1ee156666de72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a64 expref: 12 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.217485:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788642324.217489:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788642324.217493:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.217520:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046ce8a11/0x4ae1ee156666de72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a64 expref: 12 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.217547:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046ce8a11/0x4ae1ee156666de72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a64 expref: 12 pid: 9442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642324.217560:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd783480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6711:1875527107428864:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642324.217619:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5f88300 going to sleep for 11 seconds 00000004:00080000:0.0:1788642324.217654:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dddc4e34e00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788642324.217660:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107428736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788642324.218012:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:11639:x1875527086471296:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 Request processed in 80730us (81031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642324.218022:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 227 00000100:00100000:1.0:1788642324.218165:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc3666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107428992:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788642324.218198:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642324.218232:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107428992 00000100:00100000:1.0:1788642324.218237:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107428992 00000100:00100000:1.0:1788642324.218264:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788642324.218271:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3319:x1875527107428992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788642324.218288:0:6709:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1788642324.218315:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c8413, atime: 0x6a9c8413, ctime: 0x6a9c8413, blocks: 0xb 00010000:00010000:1.0:1788642324.218322:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c17cdb7/0x4ae1ee156666e0b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.218333:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=411s v=(0 0) 00010000:00010000:1.0:1788642324.218337:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642324.218343:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c17cdb7/0x4ae1ee156666e0b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.218370:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c17cdb7/0x4ae1ee156666e0b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.218380:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c17cdb7/0x4ae1ee156666e0b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.218389:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c17cdb7/0x4ae1ee156666e0b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.218413:0:6709:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788642324.218918:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3319:x1875527107428992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 645us (717us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788642324.218925:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1788642324.218945:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642324.218951:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c17cdb7/0x4ae1ee156666e0b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.218961:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bb000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642324.218965:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c17cdb7/0x4ae1ee156666e0b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.218973:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c17cdb7/0x4ae1ee156666e0b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.218990:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c17cdb7/0x4ae1ee156666e0b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.218996:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c17cdb7/0x4ae1ee156666e0b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.219020:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642324.219021:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642324.219023:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788642324.219045:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dddc3666680/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788642324.219050:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc3666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107428992:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788642324.225461:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd783480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6711:1875527107428864:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642324.225491:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788642324.232861:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788642324.232883:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1788642324.232889:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1788642324.233429:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.233534:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642324.233817:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086471552 00000100:00100000:0.0:1788642324.233826:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086471552 00000100:00100000:0.0:1788642324.233886:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:0.0:1788642324.233897:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:2360:x1875527086471552:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788642324.236895:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086471424 00000100:00100000:3.0:1788642324.236910:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086471424 00010000:00010000:3.0:1788642324.236957:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046ce8a11/0x4ae1ee156666de72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a64 expref: 14 pid: 9442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642324.237012:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:3.0:1788642324.237023:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3667480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+14:2360:x1875527086471424:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642324.237038:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642324.237044:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046ce8a11/0x4ae1ee156666de72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a64 expref: 14 pid: 9442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.237059:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046ce8a11/0x4ae1ee156666de72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a64 expref: 14 pid: 9442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.237084:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046ce8a11/0x4ae1ee156666de72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a64 expref: 14 pid: 9442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.237117:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788642324.237122:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788642324.237129:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.237227:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.237272:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642324.237336:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3667480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+13:2360:x1875527086471424:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 315us (3914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642324.237344:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 81 00010000:00010000:2.0:1788642324.240806:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.240825:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.240839:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.240859:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.240888:0:6711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788642324.242275:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642324.242286:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.242298:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:3.0:1788642324.242304:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.242315:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.242339:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.242360:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092b59daf/0x4ae1ee156666e0b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.242385:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642324.242387:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642324.242388:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642324.243633:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3318:x1875527107428608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26203us (26585us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788642324.243646:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1788642324.244018:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dddc5dcf480/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788642324.244027:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107428608:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788642324.266481:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1788642324.266501:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1788642324.266809:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086471552:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 Request processed in 32908us (33267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642324.266837:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:1.0:1788642324.271179:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642324.272789:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086471808 00000100:00100000:2.0:1788642324.272803:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086471808 00000100:00100000:2.0:1788642324.272894:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 228 00000100:00100000:2.0:1788642324.272905:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:11639:x1875527086471808:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788642324.272963:0:9441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642324.272990:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e09b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9af7 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.273012:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:2.0:1788642324.273017:0:9441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788642324.273051:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e0be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.273066:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e0be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.273076:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e0be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788642324.273395:0:9441:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb1415a9 reply state 00000000fa115987 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e0be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642324.273418:0:9441:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788642324.273531:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:11639:x1875527086471808:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 626us (2363us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788642324.273539:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 228 00010000:00010000:1.0:1788642324.276549:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e0be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.276567:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e0be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.276574:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e0be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.276579:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0e00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642324.276585:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e0be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.276593:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e0be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.276610:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:1.0:1788642324.276613:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642324.276618:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e0be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.276624:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e0be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642324.278416:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642324.278491:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086471936 00000100:00100000:0.0:1788642324.278501:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086471936 00000100:00100000:0.0:1788642324.278553:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:0.0:1788642324.278563:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086471936:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788642324.278751:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788642324.278755:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788642324 -> 1788642323 00002000:00010000:0.0:1788642324.278758:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788642323 00002000:00010000:0.0:1788642324.278760:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788642324 -> 1788642323 00002000:00010000:0.0:1788642324.278762:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788642324.278818:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086471936:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 256us (409us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788642324.278848:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:0.0:1788642324.282187:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.282281:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086472192 00000100:00100000:1.0:1788642324.282302:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086472192 00000100:00100000:1.0:1788642324.282369:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 229 00000100:00100000:1.0:1788642324.282381:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:11639:x1875527086472192:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788642324.282463:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.282482:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666e07f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ae9 expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.282492:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.282528:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666e07f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ae9 expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.282542:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666e07f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ae9 expref: 20 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642324.282556:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc3664a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107429120:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642324.282655:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5900 going to sleep for 11 seconds 00000100:00100000:2.0:1788642324.286194:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.286683:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc3664a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875527107429120:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642324.286721:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642324.286816:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086472320 00000100:00100000:0.0:1788642324.286824:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086472320 00010000:00010000:0.0:1788642324.286868:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666e07f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ae9 expref: 21 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642324.286916:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 82 00000100:00100000:0.0:1788642324.286926:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:2359:x1875527086472320:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642324.286943:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642324.286950:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666e07f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ae9 expref: 21 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.286962:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666e07f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ae9 expref: 21 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.286996:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3baa00/0x4ae1ee156666e07f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ae9 expref: 21 pid: 5863 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.287012:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:0.0:1788642324.287016:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.287026:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.287034:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.287084:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642324.287195:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:2359:x1875527086472320:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 270us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642324.287202:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 82 00010000:00010000:1.0:1788642324.287599:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.287608:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.287651:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.287659:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.287665:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.287671:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642324.287676:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.287685:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.287696:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:1.0:1788642324.287699:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788642324.287704:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.287710:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e0c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642324.287773:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:11639:x1875527086472192:12345-192.168.202.49@tcp:55:lhsmtool_posix.0 Request processed in 5392us (5593us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788642324.287780:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 229 00000100:00100000:2.0:1788642324.292821:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642324.293412:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086472448 00000100:00100000:0.0:1788642324.293422:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086472448 00000100:00100000:0.0:1788642324.293520:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:0.0:1788642324.293531:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086472448:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788642324.293575:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.293596:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b05 expref: 8 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.293605:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642324.293610:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788642324.293614:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.293648:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b05 expref: 8 pid: 9442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.293664:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b05 expref: 8 pid: 9442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642324.293679:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfd783480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6711:1875527107429248:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642324.293781:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5f88e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788642324.297010:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642324.297416:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfd783480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6711:1875527107429248:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642324.297451:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642324.297650:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086472576 00000100:00100000:1.0:1788642324.297657:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086472576 00010000:00010000:1.0:1788642324.297694:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b05 expref: 9 pid: 9442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642324.297783:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 83 00000100:00100000:1.0:1788642324.297792:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+9:2359:x1875527086472576:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642324.297807:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642324.297829:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b05 expref: 9 pid: 9442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.297842:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b05 expref: 9 pid: 9442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.297864:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000082fcdd2/0x4ae1ee156666e0a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b05 expref: 9 pid: 9442 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.297879:0:5845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788642324.297883:0:5845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788642324.297888:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.297897:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.297927:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642324.297994:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2359:x1875527086472576:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 202us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642324.298001:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 83 00010000:00010000:2.0:1788642324.298065:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.298075:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.298114:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.298123:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.298131:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.298161:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5de00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642324.298166:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.298176:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.298189:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.298197:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000271e7f31/0x4ae1ee156666e0cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642324.298242:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086472448:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 Request processed in 4714us (5432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642324.298250:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 70 00000100:00100000:3.0:1788642324.301334:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642324.301420:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086472832 00000100:00100000:2.0:1788642324.301431:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086472832 00000100:00100000:2.0:1788642324.301494:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 230 00000100:00100000:2.0:1788642324.301504:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:11639:x1875527086472832:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788642324.301583:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666e0d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.301602:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666e0d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.301631:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666e0d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.301848:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.301861:0:9441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e08d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9af0 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.301871:0:9441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.301910:0:9441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e08d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9af0 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.301926:0:9441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e08d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9af0 expref: 20 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642324.301941:0:9441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaf80380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9441:1875527107429376:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788642324.302043:0:9441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc8c7c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788642324.305023:0:9441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaf80380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9441:1875527107429376:192.168.202.49@tcp:104: 00010000:00010000:2.0:1788642324.305054:0:9441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642324.307641:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642324.307740:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086472960 00000100:00100000:2.0:1788642324.307752:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086472960 00010000:00010000:2.0:1788642324.307801:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e08d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9af0 expref: 21 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642324.307861:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:2.0:1788642324.307871:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:2360:x1875527086472960:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788642324.307887:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642324.307894:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e08d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9af0 expref: 21 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.307906:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e08d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9af0 expref: 21 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.307927:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e08d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9af0 expref: 21 pid: 5862 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.307943:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:2.0:1788642324.307948:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.307958:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.307965:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642324.308006:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642324.308059:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:2360:x1875527086472960:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 189us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642324.308065:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 84 00010000:00010000:3.0:1788642324.308839:0:9441:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.308850:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788642324.309044:0:9441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788642324.309236:0:9441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788642324.309293:0:9441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788642324.309399:0:9441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad39880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9441:1875527107429504:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788642324.309464:0:9441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642324.309499:0:9441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddcdd18300 going to sleep for 11 seconds 00000100:00100000:2.0:1788642324.309573:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107429504 00000100:00100000:2.0:1788642324.309588:0:5867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107429504 00000100:00100000:2.0:1788642324.309632:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788642324.309641:0:5867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9441:x1875527107429504:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788642324.309732:0:5867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9441:x1875527107429504:12345-0@lo:1000:mdt00_003.0 Request processed in 92us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642324.309740:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788642324.309829:0:9441:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1788642324.309837:0:9441:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1788642324.309861:0:9441:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dddc4e34e00, transno 4294967321 00000100:00100000:0.0:1788642324.309882:0:9441:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8dddc5dcf480 x1875527107428608/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788642340 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642324.309896:0:9441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad39880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9441:1875527107429504:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788642324.310585:0:9441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788642324.310665:0:9441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9441:1875527107429632:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788642324.310718:0:9441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642324.310743:0:9441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0b0dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642324.310852:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107429632 00000100:00100000:3.0:1788642324.310858:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107429632 00000100:00100000:3.0:1788642324.310891:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788642324.310900:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9441:x1875527107429632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788642324.311677:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef152300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9441:x1875527107429632:12345-0@lo:1000:mdt00_003.0 Request processed in 775us (955us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788642324.311685:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788642324.312483:0:9441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9441:1875527107429632:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788642324.312529:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312540:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312549:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312555:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1800 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642324.312559:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312568:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312597:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:0.0:1788642324.312601:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788642324.312606:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312612:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e0da lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312652:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e01d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312659:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e01d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312665:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e01d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312670:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642324.312672:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e01d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312678:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e01d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312686:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:0.0:1788642324.312688:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788642324.312695:0:9441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666e024 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ad4 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312706:0:9441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666e024 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ad4 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312722:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666e024 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ad4 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.312755:0:9441:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666e024 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ad4 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642324.312768:0:9441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab08000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9441:1875527107429760:192.168.202.49@tcp:105: 00000100:00100000:0.0:1788642324.312852:0:9441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0b0dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642324.316647:0:9441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab08000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9441:1875527107429760:192.168.202.49@tcp:105: 00010000:00010000:0.0:1788642324.316677:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e01d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316689:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba000/0x4ae1ee156666e01d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316722:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666e0e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316736:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666e0e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316747:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666e0e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316758:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666e0e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316764:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666e0e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316783:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666e0e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316789:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642324.316793:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666e0e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316801:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666e0e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316812:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:0.0:1788642324.316816:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642324.316819:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666e0e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316825:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5c400/0x4ae1ee156666e0e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316835:0:9441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666e0d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316841:0:9441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666e0d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316847:0:9441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666e0d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316851:0:9441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642324.316854:0:9441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666e0d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316868:0:9441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666e0d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316877:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:0.0:1788642324.316880:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788642324.316883:0:9441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666e0d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.316889:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1600/0x4ae1ee156666e0d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788642324.317474:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642324.317480:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642324.317953:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788642324.317961:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788642324.318058:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:11639:x1875527086472832:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 16551us (17001us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788642324.318069:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 230 00000020:00080000:0.0:1788642324.318074:0:9441:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788642324.319929:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642324.322272:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642324.322874:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086473088 00000100:00100000:0.0:1788642324.322886:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086473088 00000100:00100000:0.0:1788642324.322931:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086473344 00000100:00100000:0.0:1788642324.322934:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086473344 00000100:00100000:0.0:1788642324.322951:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:0.0:1788642324.322959:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:11638:x1875527086473088:12345-192.168.202.49@tcp:49:lfs.0 00000100:00100000:0.0:1788642324.323443:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+24:11638:x1875527086473088:12345-192.168.202.49@tcp:49:lfs.0 Request processed in 480us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642324.323451:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 61 00000100:00100000:0.0:1788642324.323473:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 62 00000100:00100000:0.0:1788642324.323480:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddddbdcb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+23:11639:x1875527086473344:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788642324.324294:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788642324.324419:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788642324.324465:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666e0e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.324481:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666e0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.324492:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666e0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.324500:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666e0e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.324507:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666e0e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.324514:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666e0e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642324.324592:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788642324.324662:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddddbdcb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:11639:x1875527086473344:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 1180us (2399us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788642324.324670:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 62 00000020:00080000:0.0:1788642324.324675:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788642324.328326:0:7657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642324.328353:0:7657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666e0e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.328365:0:7657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5ce00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:3.0:1788642324.328388:0:7657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666e0e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.328400:0:7657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666e0e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.328419:0:7657:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dddc2c20300) 00010000:00010000:3.0:1788642324.328421:0:7657:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788642324.328426:0:7657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666e0e8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.328432:0:7657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfaa5ce00/0x4ae1ee156666e0e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642324.328701:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642324.328776:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086473600 00000100:00100000:3.0:1788642324.328786:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086473600 00000100:00100000:3.0:1788642324.328848:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 231 00000100:00100000:3.0:1788642324.328858:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:11638:x1875527086473600:12345-192.168.202.49@tcp:58:lfs.0 00000040:00080000:3.0:1788642324.329199:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788642324.329308:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:11638:x1875527086473600:12345-192.168.202.49@tcp:58:lfs.0 Request processed in 450us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642324.329317:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 231 00010000:00010000:2.0:1788642324.332529:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642324.332537:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642324.332540:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642324.354933:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642324.355004:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086473728 00000100:00100000:3.0:1788642324.355013:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086473728 00000100:00100000:3.0:1788642324.355069:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 232 00000100:00100000:3.0:1788642324.355077:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaf80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+25:11641:x1875527086473728:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642324.355094:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642324.355131:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e0ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9b0c expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.355208:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666e0f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.355219:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666e0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.355228:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666e0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.355237:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e0fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.355242:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e0fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.355246:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e0fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.355469:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e104 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.355480:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9acd expref: 26 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.355488:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e104 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.355519:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9acd expref: 26 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.355542:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9acd expref: 26 pid: 9441 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642324.355556:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad39180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107429888:192.168.202.49@tcp:104: 00000100:00100000:3.0:1788642324.355641:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd13dfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788642324.358185:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642324.358712:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad39180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875527107429888:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642324.358745:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e104 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642324.358849:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086473984 00000100:00100000:2.0:1788642324.358856:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086473984 00000100:00100000:2.0:1788642324.358945:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:2.0:1788642324.358954:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:5613:x1875527086473984:12345-192.168.202.49@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788642324.359419:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:5613:x1875527086473984:12345-192.168.202.49@tcp:35:ldlm_bl.0 Request processed in 464us (1240us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788642324.359426:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 63 00000100:00100000:3.0:1788642324.361130:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642324.361243:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086474112 00000100:00100000:1.0:1788642324.361253:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086474112 00010000:00010000:1.0:1788642324.361289:0:5845:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9acd expref: 28 pid: 9441 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642324.361335:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:1.0:1788642324.361354:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:2360:x1875527086474112:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642324.361370:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642324.361377:0:5845:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9acd expref: 28 pid: 9441 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.361390:0:5845:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9acd expref: 28 pid: 9441 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.361416:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e00f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9acd expref: 28 pid: 9441 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.361433:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642324.361438:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e104 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.361448:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.361456:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e104 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642324.361495:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642324.361526:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.361534:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642324.361545:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:2360:x1875527086474112:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 202us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642324.361551:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 85 00000004:00200000:3.0:1788642324.361576:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788642324.361581:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642324.361600:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.361614:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e104 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.361624:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666e0f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.361780:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666e0f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.361789:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666e0f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.361975:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffabc00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642324.361980:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666e0f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.361987:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666e0f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.361997:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:3.0:1788642324.362000:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642324.362003:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666e0f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.362009:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabc00/0x4ae1ee156666e0f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.362021:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e0fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.362026:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e0fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.362032:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e0fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.362037:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaa000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642324.362040:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e0fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.362046:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e0fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.362178:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ddde02b5400) 00010000:00010000:3.0:1788642324.362181:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642324.362185:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e0fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.362191:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e0fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.362230:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e0ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b0c expref: 27 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.362246:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e104 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b0c expref: 26 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642324.362254:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:3.0:1788642324.362256:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642324.362259:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffab600, rc 0) 00000100:00100000:3.0:1788642324.362312:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaf80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:11641:x1875527086473728:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 7235us (7389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642324.362320:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 232 00010000:00010000:1.0:1788642324.412653:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642324.669545:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642324.669567:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc3667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107430016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788642324.669649:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642324.669775:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107430016 00000100:00100000:0.0:1788642324.669783:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107430016 00000100:00100000:0.0:1788642324.669837:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788642324.669848:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875527107430016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788642324.669896:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642324.669948:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875527107430016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642324.669955:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788642324.669989:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788642324.669994:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dddfaa6fb80, transno 4294967307 00000004:00080000:0.0:1788642324.670004:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1788642324.670025:0:3319:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8dddc3666680 x1875527107428992/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788642340 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642324.670040:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc3667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107430016:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788642325.370670:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788642325.370682:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788642325.370723:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788642325.370729:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788642325.371162:0:11714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfab08000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11714:1875527107430144:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788642325.371607:0:11714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddddc2c6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788642325.384720:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642325.385483:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086474240 00000100:00100000:2.0:1788642325.385495:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086474240 00000100:00100000:2.0:1788642325.385557:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 233 00000100:00100000:2.0:1788642325.385567:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:11652:x1875527086474240:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788642325.385605:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788642325.385715:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:11652:x1875527086474240:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 149us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642325.385733:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 233 00000100:00100000:3.0:1788642325.389952:0:11714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfab08000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11714:1875527107430144:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788642325.392203:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642325.392253:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086474496 00000100:00100000:2.0:1788642325.392262:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086474496 00000100:00100000:2.0:1788642325.392394:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 234 00000100:00100000:2.0:1788642325.392406:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+26:11652:x1875527086474496:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788642325.392427:0:9441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642325.392447:0:9441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666e10b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9b13 expref: -99 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642325.392551:0:9441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1200/0x4ae1ee156666e112 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642325.392567:0:9441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1200/0x4ae1ee156666e112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642325.392581:0:9441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1200/0x4ae1ee156666e112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642325.392591:0:9441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788642325.392702:0:9441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0a00/0x4ae1ee156666e10b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b13 expref: 29 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642325.392719:0:9441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1200/0x4ae1ee156666e112 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b13 expref: 28 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642325.392728:0:9441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:2.0:1788642325.392731:0:9441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788642325.392734:0:9441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1200, rc 0) 00000100:00100000:2.0:1788642325.392796:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:11652:x1875527086474496:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 393us (608us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788642325.392804:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 234 00000100:00100000:2.0:1788642325.395413:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642325.400180:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086474624 00000100:00100000:0.0:1788642325.400195:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086474624 00000100:00100000:0.0:1788642325.400264:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:0.0:1788642325.400275:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7e7c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:2360:x1875527086474624:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642325.400289:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642325.400334:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1200/0x4ae1ee156666e112 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b13 expref: 28 pid: 9441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642325.400363:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:0.0:1788642325.400368:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642325.400426:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7e7c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:2360:x1875527086474624:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 153us (5023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642325.400433:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:0.0:1788642325.407851:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642325.409844:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086474880 00000100:00100000:1.0:1788642325.409863:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086474880 00000100:00100000:1.0:1788642325.410264:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 235 00000100:00100000:1.0:1788642325.410278:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+27:11652:x1875527086474880:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788642325.410380:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e120 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.410400:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.411063:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.411323:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.411333:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e120 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.411340:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e120 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.411366:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bbe00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642325.411371:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e120 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.411379:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e120 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.411394:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642325.411397:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788642325.411401:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e120 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.411418:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e120 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642325.411595:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:11652:x1875527086474880:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 1317us (3750us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788642325.411605:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 235 00000040:00080000:0.0:1788642325.413502:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788642325.413513:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788642325.413994:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788642325.414004:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788642325.421502:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642325.421549:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086475136 00000100:00100000:1.0:1788642325.421558:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086475136 00000100:00100000:1.0:1788642325.421611:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 64 00000100:00100000:1.0:1788642325.421621:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+28:11652:x1875527086475136:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788642325.422007:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:11652:x1875527086475136:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 385us (512us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788642325.422015:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 64 00010000:00010000:0.0:1788642325.435304:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788642325.634836:0:12590:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788642325.634846:0:12590:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788642325.634900:0:12590:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788642325.634906:0:12590:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788642325.965479:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642325.970786:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086475392 00000100:00100000:3.0:1788642325.970803:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086475392 00000100:00100000:3.0:1788642325.970969:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 236 00000100:00100000:3.0:1788642325.970980:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+29:11665:x1875527086475392:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642325.971003:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642325.971032:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e127 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9b1a expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642325.971150:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e12e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642325.971165:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e12e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642325.971180:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e12e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642325.971191:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788642325.971325:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e127 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b1a expref: 32 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642325.971343:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e12e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b1a expref: 31 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642325.971352:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:3.0:1788642325.971355:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788642325.971359:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffab800, rc 0) 00000100:00100000:3.0:1788642325.971426:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:11665:x1875527086475392:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 448us (5954us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788642325.971433:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 236 00000100:00100000:1.0:1788642325.983420:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642325.983460:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086475520 00000100:00100000:1.0:1788642325.983470:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086475520 00000100:00100000:1.0:1788642325.983515:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 237 00000100:00100000:1.0:1788642325.983524:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:11665:x1875527086475520:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:1.0:1788642325.983587:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e13c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.983604:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e13c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.983615:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e13c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.983639:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e13c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.983645:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e13c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.983651:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e13c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.983656:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bbe00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642325.983660:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e13c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.983667:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e13c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.983688:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:1.0:1788642325.983691:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788642325.983696:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e13c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642325.983702:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bbe00/0x4ae1ee156666e13c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642325.983761:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:11665:x1875527086475520:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 238us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642325.983769:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 237 00000100:00100000:0.0:1788642326.138544:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642326.138673:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086475648 00000100:00100000:1.0:1788642326.138688:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086475648 00000100:00100000:1.0:1788642326.138785:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 71 00000100:00100000:1.0:1788642326.138796:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086475648:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:1.0:1788642326.138815:0:6712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642326.138836:0:6712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005a07ef4/0x4ae1ee156666e143 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9b21 expref: -99 pid: 6712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788642326.138863:0:6712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9c8413, atime: 0x6a9c8413, ctime: 0x6a9c8413, blocks: 0xb 00010000:00010000:1.0:1788642326.138883:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1788642326.138887:0:6712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642326.138897:0:6712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a07ef4/0x4ae1ee156666e143 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b21 expref: 8 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642326.138914:0:6712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005a07ef4/0x4ae1ee156666e143 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b21 expref: 8 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642326.138946:0:6712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3bbe00, rc 0) 00000100:00100000:1.0:1788642326.139010:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086475648:12345-192.168.202.49@tcp:101:cat.0 Request processed in 217us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642326.139017:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 71 00000100:00080000:2.0:1788642326.139573:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788642326.143853:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642326.144362:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086475776 00000100:00100000:0.0:1788642326.144372:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086475776 00002000:00100000:1.0:1788642326.144507:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8dddc3665500 x1875527086475776/t0(0) o3->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:527/0 lens 488/0 e 0 to 0 dl 1788642337 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788642326.144518:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddc3665500 with x1875527086475776 ext(0->4095) 00002000:00010000:1.0:1788642326.144524:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddc3665500 00000100:00100000:1.0:1788642326.144590:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:1.0:1788642326.144601:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086475776:12345-192.168.202.49@tcp:3:cat.0 00000100:00100000:1.0:1788642326.144979:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2360:x1875527086475776:12345-192.168.202.49@tcp:3:cat.0 Request processed in 378us (1135us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788642326.144987:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00002000:00100000:1.0:1788642326.144994:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8dddc3665500 x1875527086475776/t0(0) o3->e32b659c-dd8d-40c5-94b4-b9b0e719a356@192.168.202.49@tcp:527/0 lens 488/4536 e 0 to 0 dl 1788642337 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788642326.145003:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dddc3665500 with x1875527086475776 ext(0->4095) 00002000:00010000:1.0:1788642326.145006:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dddc3665500 00010000:00010000:2.0:1788642326.458959:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642327.192976:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642327.193122:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642327.193157:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642327.193158:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086476160 00000100:00100000:3.0:1788642327.193179:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642327.193180:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086476160 00000100:00100000:3.0:1788642327.193232:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642327.193247:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086476288 00000100:00100000:1.0:1788642327.193250:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086476288 00000100:00100000:3.0:1788642327.193261:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086476416 00000100:00100000:3.0:1788642327.193265:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086476416 00000100:00100000:1.0:1788642327.193284:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 99 00000100:00100000:3.0:1788642327.193293:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086476032 00000100:00100000:3.0:1788642327.193296:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086476032 00000100:00100000:1.0:1788642327.193301:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086476160:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642327.193314:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 169 00000100:00100000:3.0:1788642327.193320:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2361:x1875527086476416:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642327.193746:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2361:x1875527086476416:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 424us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642327.193756:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 169 00000100:00100000:3.0:1788642327.193774:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 170 00000100:00100000:3.0:1788642327.193783:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:2361:x1875527086476032:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642327.194961:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086475904 00000100:00100000:0.0:1788642327.194973:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086475904 00000100:00100000:0.0:1788642327.195200:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 300 00000100:00100000:0.0:1788642327.195221:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:2361:x1875527086475904:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642327.208323:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086476160:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 15010us (15213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642327.208339:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 99 00000100:00100000:1.0:1788642327.208377:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00100000:1.0:1788642327.208394:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2361:x1875527086476288:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642327.208479:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+8:2361:x1875527086476288:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 94us (15246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642327.208486:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00080000:1.0:1788642327.208515:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788642327.208522:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642327.219364:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+31:2361:x1875527086476032:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 25570us (26171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642327.219380:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 170 00000100:00100000:0.0:1788642327.227322:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:2361:x1875527086475904:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 32096us (34339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642327.227337:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 300 00010000:00010000:1.0:1788642327.484959:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642328.259845:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107430400:0@lo:400:kworker.0 00000100:00100000:0.0:1788642328.259933:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642328.260003:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107430912:0@lo:400:kworker.0 00000100:00100000:0.0:1788642328.260029:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642328.260065:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788642328.260072:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107430272:0@lo:400:kworker.0 00000100:00100000:0.0:1788642328.260127:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642328.260151:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107430784:0@lo:400:kworker.0 00000100:00100000:0.0:1788642328.260182:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642328.260205:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107430528:0@lo:400:kworker.0 00000100:00100000:0.0:1788642328.260231:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642328.260247:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642328.260253:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107430656:0@lo:400:kworker.0 00000100:00100000:0.0:1788642328.260276:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642328.260307:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107430272 00000100:00100000:0.0:1788642328.260315:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107430272 00000100:00100000:0.0:1788642328.260358:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788642328.260367:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107430272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642328.260431:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107430272:12345-0@lo:400:kworker.0 Request processed in 63us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642328.260439:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788642328.260499:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107430272:0@lo:400:kworker.0 00000100:00100000:1.0:1788642328.260968:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107430400 00000100:00100000:1.0:1788642328.260975:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107430400 00000100:00100000:1.0:1788642328.261016:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107430784 00000100:00100000:1.0:1788642328.261019:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107430784 00000100:00100000:1.0:1788642328.261041:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107430528 00000100:00100000:1.0:1788642328.261043:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107430528 00000100:00100000:1.0:1788642328.261068:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788642328.261076:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107430400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642328.261151:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107430400:12345-0@lo:400:kworker.0 Request processed in 76us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642328.261169:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788642328.261183:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788642328.261189:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107430784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642328.261219:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107430784:12345-0@lo:400:kworker.0 Request processed in 31us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642328.261234:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788642328.261246:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788642328.261252:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107430528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642328.261285:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107430528:12345-0@lo:400:kworker.0 Request processed in 33us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642328.261291:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788642328.261311:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107430912 00000100:00100000:1.0:1788642328.261314:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107430912 00000100:00100000:1.0:1788642328.261340:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107430656 00000100:00100000:1.0:1788642328.261343:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107430656 00000100:00100000:1.0:1788642328.261362:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788642328.261368:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1875527107430912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642328.261402:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1875527107430912:12345-0@lo:400:kworker.0 Request processed in 34us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642328.261408:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788642328.261418:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788642328.261424:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875527107430656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642328.261449:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875527107430656:12345-0@lo:400:kworker.0 Request processed in 26us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642328.261454:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788642328.261487:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788642328.261492:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788642328.261495:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642328.261531:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107430656:0@lo:400:kworker.0 00000100:00100000:1.0:1788642328.261543:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107430528:0@lo:400:kworker.0 00000100:00100000:1.0:1788642328.261587:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107430784:0@lo:400:kworker.0 00000100:00100000:1.0:1788642328.261597:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107430400:0@lo:400:kworker.0 00000100:00100000:1.0:1788642328.261606:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107430912:0@lo:400:kworker.0 00010000:00010000:0.0:1788642328.506318:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642328.762807:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc3666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107431040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788642328.762895:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642328.764266:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107431040 00000100:00100000:1.0:1788642328.764279:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107431040 00000100:00100000:1.0:1788642328.764354:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788642328.764365:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1875527107431040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642328.764406:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642328.764492:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1875527107431040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642328.764500:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788642328.764785:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc3666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107431040:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788642329.402779:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1788642329.402802:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1788642329.402815:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1788642329.428482:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788642329.437394:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000020:00080000:1.0:1788642329.437415:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dddc5f88000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788642329.437420:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dddd0b54800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dddc5f88e40 00000020:00080000:1.0:1788642329.437424:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dddd0b54100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dddc64b7800 00000020:00080000:1.0:1788642329.437433:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1788642329.437440:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:1.0:1788642329.437469:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788642329.437624:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788642329.437982:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788642329.536430:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642329.799381:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642329.799406:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc3665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107431168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788642329.799485:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642329.799547:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107431168 00000100:00100000:1.0:1788642329.799565:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107431168 00000100:00100000:1.0:1788642329.799620:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788642329.799630:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107431168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788642329.801159:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642329.801243:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107431168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1612us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642329.801252:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788642329.804079:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788642329.804113:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dddc3666680, transno 4294967310 00000100:00100000:2.0:1788642329.804140:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc3665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107431168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788642330.554368:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642331.579204:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642332.336323:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642332.336378:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642332.336419:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086476928 00000100:00100000:0.0:1788642332.336431:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086476928 00000100:00100000:0.0:1788642332.336520:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 103 00000100:00100000:0.0:1788642332.336533:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2361:x1875527086476928:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642332.336610:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2361:x1875527086476928:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642332.336619:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 103 00000100:00080000:0.0:1788642332.336656:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788642332.336697:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642332.338288:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086476672 00000100:00100000:3.0:1788642332.338301:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086476672 00000100:00100000:3.0:1788642332.338368:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 174 00000100:00100000:3.0:1788642332.338381:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:2361:x1875527086476672:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642332.338445:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:2361:x1875527086476672:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 68us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642332.338452:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 174 00000100:00100000:0.0:1788642332.341418:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642332.341513:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642332.341555:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086476544 00000100:00100000:0.0:1788642332.341564:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086476544 00000100:00100000:0.0:1788642332.341617:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 302 00000100:00100000:0.0:1788642332.341627:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:2361:x1875527086476544:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642332.341685:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+13:2361:x1875527086476544:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 60us (4987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642332.341693:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 302 00000100:00100000:0.0:1788642332.341724:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086477056 00000100:00100000:0.0:1788642332.341728:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086477056 00000100:00100000:0.0:1788642332.341769:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 175 00000100:00100000:0.0:1788642332.341776:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2361:x1875527086477056:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642332.341804:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:2361:x1875527086477056:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 29us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642332.341818:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 175 00000100:00080000:0.0:1788642332.341907:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642332.342092:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086476800 00000100:00100000:3.0:1788642332.342117:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086476800 00000100:00100000:3.0:1788642332.342229:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 104 00000100:00100000:3.0:1788642332.342238:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086476800:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642332.342276:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2361:x1875527086476800:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 40us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642332.342283:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 104 00000100:00080000:0.0:1788642332.344560:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788642332.603790:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788642332.603799:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788642332.604085:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788642332.604092:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788642332.606870:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642332.843715:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642332.846209:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086477184 00000100:00100000:3.0:1788642332.846226:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086477184 00000100:00100000:2.0:1788642332.846825:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 238 00000100:00100000:2.0:1788642332.846841:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:11318:x1875527086477184:12345-192.168.202.49@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788642332.847390:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:11318:x1875527086477184:12345-192.168.202.49@tcp:60:lhsmtool_posix.0 Request processed in 549us (3679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642332.847398:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 238 00000100:00100000:0.0:1788642332.862382:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642332.865714:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086477440 00000100:00100000:2.0:1788642332.865875:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086477440 00000100:00100000:2.0:1788642332.866028:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:2.0:1788642332.866039:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:11318:x1875527086477440:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788642332.866399:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:11318:x1875527086477440:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 361us (4025us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788642332.866407:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 65 00000100:00100000:1.0:1788642333.370655:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107431296:0@lo:400:kworker.0 00000100:00100000:1.0:1788642333.370732:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642333.370787:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107431808:0@lo:400:kworker.0 00000100:00100000:1.0:1788642333.370814:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642333.370839:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788642333.370846:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107431424:0@lo:400:kworker.0 00000100:00100000:1.0:1788642333.370868:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642333.370886:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107431936:0@lo:400:kworker.0 00000100:00100000:1.0:1788642333.370906:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642333.370950:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107431296 00000100:00100000:1.0:1788642333.370957:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107431296 00000100:00100000:1.0:1788642333.371010:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788642333.371018:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107431296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642333.371063:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5b43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107431296:12345-0@lo:400:kworker.0 Request processed in 46us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642333.371071:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788642333.371124:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107431808 00000100:00100000:1.0:1788642333.371135:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107431808 00000100:00100000:1.0:1788642333.371172:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788642333.371179:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107431808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642333.371210:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107431808:12345-0@lo:400:kworker.0 Request processed in 33us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642333.371216:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788642333.371227:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107431424 00000100:00100000:1.0:1788642333.371230:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107431424 00000100:00100000:1.0:1788642333.371247:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788642333.371253:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107431424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642333.371279:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107431424:12345-0@lo:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642333.371285:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788642333.371307:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107431936 00000100:00100000:1.0:1788642333.371310:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107431936 00000100:00100000:1.0:1788642333.371335:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788642333.371341:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107431936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642333.371370:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107431936:12345-0@lo:400:kworker.0 Request processed in 30us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642333.371376:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1788642333.371392:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788642333.371397:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642333.371425:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107431424:0@lo:400:kworker.0 00000100:00100000:1.0:1788642333.371434:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788642333.371439:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dddc5dcf480, transno 4294967322 00000004:00080000:1.0:1788642333.371449:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788642333.371475:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107431936:0@lo:400:kworker.0 00000100:00100000:1.0:1788642333.371494:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107431296:0@lo:400:kworker.0 00000100:00100000:1.0:1788642333.371503:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107431808:0@lo:400:kworker.0 00000100:00100000:2.0:1788642333.372367:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107431552:0@lo:400:kworker.0 00000100:00100000:2.0:1788642333.372421:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642333.372470:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107431552 00000100:00100000:2.0:1788642333.372476:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107431552 00000100:00100000:2.0:1788642333.372526:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788642333.372533:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107431552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642333.372583:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107431552:12345-0@lo:400:kworker.0 Request processed in 50us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642333.372589:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:2.0:1788642333.372614:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642333.372634:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107431552:0@lo:400:kworker.0 00000100:00100000:3.0:1788642333.373020:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107431680:0@lo:400:kworker.0 00000100:00100000:3.0:1788642333.373054:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642333.373262:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107431680 00000100:00100000:2.0:1788642333.373266:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107431680 00000100:00100000:2.0:1788642333.373314:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788642333.373322:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107431680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642333.373368:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107431680:12345-0@lo:400:kworker.0 Request processed in 48us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642333.373376:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788642333.373445:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107431680:0@lo:400:kworker.0 00000100:00080000:1.0:1788642333.373496:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788642333.458898:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642333.459012:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086477568 00000100:00100000:1.0:1788642333.459023:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086477568 00000100:00100000:1.0:1788642333.459091:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 239 00000100:00100000:1.0:1788642333.459131:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+5:12117:x1875527086477568:12345-192.168.202.49@tcp:101:lsof.0 00010000:00010000:1.0:1788642333.459156:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642333.459184:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb000/0x4ae1ee156666e14a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9b28 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642333.459257:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e151 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642333.459271:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642333.459280:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642333.459314:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788642333.459318:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642333.459343:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642333.459370:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb000/0x4ae1ee156666e14a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b28 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642333.459390:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b28 expref: 6 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642333.459427:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365ff00) 00010000:00010000:1.0:1788642333.459430:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788642333.459434:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3ba400, rc 0) 00000100:00100000:1.0:1788642333.459497:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:12117:x1875527086477568:12345-192.168.202.49@tcp:101:lsof.0 Request processed in 397us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642333.459503:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 239 00010000:00010000:1.0:1788642333.626386:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642333.882806:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788642333.882836:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc3667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107432064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788642333.882929:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642333.883315:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107432064 00000100:00100000:1.0:1788642333.883325:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107432064 00000100:00100000:1.0:1788642333.883406:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788642333.883417:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107432064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642333.883465:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642333.883528:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107432064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642333.883537:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788642333.883920:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc3667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107432064:0@lo:13:osp-pre-1-0.0 00000020:00080000:1.0:1788642334.568729:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788642334.568926:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788642334.568944:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1788642334.569286:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:0.0:1788642334.650397:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642334.907021:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788642334.907054:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc3667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107432192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788642334.907170:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642334.907553:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107432192 00000100:00100000:1.0:1788642334.907564:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107432192 00000100:00100000:0.0:1788642334.907783:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788642334.907796:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107432192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788642334.907834:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642334.907907:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107432192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642334.907915:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788642334.908422:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc3667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107432192:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788642335.676548:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642336.698537:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642337.455799:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642337.455883:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642337.455917:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642337.455947:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642337.455975:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642337.456016:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086478208 00000100:00100000:0.0:1788642337.456026:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086478208 00000100:00100000:0.0:1788642337.456085:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086477824 00000100:00100000:0.0:1788642337.456088:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086477824 00000100:00100000:0.0:1788642337.456155:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 179 00000100:00100000:0.0:1788642337.456164:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2359:x1875527086478208:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642337.456235:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2359:x1875527086478208:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 72us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642337.456244:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 179 00000100:00100000:0.0:1788642337.456260:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 180 00000100:00100000:0.0:1788642337.456265:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:2359:x1875527086477824:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642337.456289:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:2359:x1875527086477824:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 24us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642337.456295:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 180 00000100:00100000:0.0:1788642337.456315:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086477952 00000100:00100000:0.0:1788642337.456318:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086477952 00000100:00100000:0.0:1788642337.456344:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086478080 00000100:00100000:0.0:1788642337.456347:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086478080 00000100:00100000:0.0:1788642337.456364:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 107 00000100:00100000:0.0:1788642337.456370:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2359:x1875527086477952:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642337.456394:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2359:x1875527086477952:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 24us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642337.456400:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 107 00000100:00100000:0.0:1788642337.456408:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 108 00000100:00100000:0.0:1788642337.456413:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086478080:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642337.456431:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2359:x1875527086478080:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 18us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642337.456437:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 108 00000100:00080000:0.0:1788642337.456450:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642337.456458:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788642337.456461:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642337.456696:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086477696 00000100:00100000:1.0:1788642337.456700:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086477696 00000100:00100000:1.0:1788642337.456744:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 304 00000100:00100000:1.0:1788642337.456752:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086477696:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642337.456781:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9684ea0b-8125-4caf-b771-9063c6354463+13:2359:x1875527086477696:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 31us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642337.456795:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 304 00010000:00010000:3.0:1788642337.726311:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788642338.075767:0:12793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 17:05:36 (1788642336) 00000100:00100000:2.0:1788642338.492602:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107432448:0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.492876:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642338.492955:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107432960:0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.492999:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642338.493046:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788642338.493052:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107432320:0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.493082:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642338.493133:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107432832:0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.493158:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642338.493190:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107432960 00000100:00100000:2.0:1788642338.493197:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107432960 00000100:00100000:2.0:1788642338.493256:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788642338.493266:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107432960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.493320:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107432960:12345-0@lo:400:kworker.0 Request processed in 55us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642338.493327:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788642338.493348:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107432320 00000100:00100000:2.0:1788642338.493352:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107432320 00000100:00100000:2.0:1788642338.493375:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788642338.493381:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107432320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.493406:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107432320:12345-0@lo:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642338.493412:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788642338.493437:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107432448 00000100:00100000:2.0:1788642338.493441:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107432448 00000100:00100000:2.0:1788642338.493461:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107432832 00000100:00100000:2.0:1788642338.493464:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107432832 00000100:00100000:2.0:1788642338.493485:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788642338.493491:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107432448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.493520:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeffad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107432448:12345-0@lo:400:kworker.0 Request processed in 30us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642338.493533:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788642338.493546:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788642338.493552:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107432832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.493578:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107432832:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642338.493583:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:2.0:1788642338.493597:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788642338.493601:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788642338.493632:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107432320:0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.493644:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107432832:0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.493651:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107432448:0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.493660:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107432960:0@lo:400:kworker.0 00000100:00100000:3.0:1788642338.494156:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107432576:0@lo:400:kworker.0 00000100:00100000:3.0:1788642338.494188:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642338.494218:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642338.494224:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107432704:0@lo:400:kworker.0 00000100:00100000:3.0:1788642338.494244:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642338.494363:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107432704 00000100:00100000:0.0:1788642338.494369:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107432704 00000100:00100000:0.0:1788642338.494420:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788642338.494429:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107432704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642338.494468:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107432704:12345-0@lo:400:kworker.0 Request processed in 42us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642338.494474:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1788642338.494535:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642338.494603:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107432704:0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.494666:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107432576 00000100:00100000:2.0:1788642338.494680:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107432576 00000100:00100000:2.0:1788642338.494726:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788642338.494733:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107432576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642338.494821:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107432576:12345-0@lo:400:kworker.0 Request processed in 88us (630us total) trans 0 rc 0/0 00000100:00080000:1.0:1788642338.494935:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642338.495022:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788642338.496398:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107432576:0@lo:400:kworker.0 00010000:00010000:1.0:1788642338.747666:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642339.014431:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc3667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107433088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788642339.014511:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642339.014622:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107433088 00000100:00100000:1.0:1788642339.014631:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107433088 00000100:00100000:1.0:1788642339.014709:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788642339.014720:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107433088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642339.014989:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642339.015051:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107433088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 332us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642339.015058:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788642339.015167:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc3667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107433088:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788642339.770279:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642340.028590:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc3667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107433216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788642340.028718:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642340.028812:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107433216 00000100:00100000:0.0:1788642340.028832:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107433216 00000100:00100000:0.0:1788642340.028957:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788642340.028970:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107433216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788642340.029030:0:6714:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642340.029190:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107433216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 221us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642340.029200:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788642340.029240:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788642340.034660:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc3667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107433216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788642340.800486:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642341.818882:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642342.569882:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642342.569963:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642342.570004:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642342.570042:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642342.570072:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642342.570566:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086478592 00000100:00100000:2.0:1788642342.570587:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086478592 00000100:00100000:2.0:1788642342.570664:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086478720 00000100:00100000:2.0:1788642342.570668:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086478720 00000100:00100000:2.0:1788642342.570703:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 111 00000100:00100000:2.0:1788642342.570716:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086478592:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642342.570826:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2360:x1875527086478592:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 113us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642342.570834:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 111 00000100:00100000:2.0:1788642342.570855:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 112 00000100:00100000:2.0:1788642342.570862:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086478720:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642342.570891:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2360:x1875527086478720:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 29us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642342.570897:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 112 00000100:00100000:2.0:1788642342.570918:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086478848 00000100:00100000:2.0:1788642342.570921:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086478848 00000100:00100000:2.0:1788642342.570949:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086478464 00000100:00100000:2.0:1788642342.570951:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086478464 00000100:00100000:2.0:1788642342.570972:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 184 00000100:00100000:2.0:1788642342.570978:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2360:x1875527086478848:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642342.571009:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2360:x1875527086478848:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 31us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642342.571015:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 184 00000100:00100000:2.0:1788642342.571044:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 185 00000100:00100000:2.0:1788642342.571050:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:2360:x1875527086478464:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642342.571074:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:2360:x1875527086478464:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 25us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642342.571088:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 185 00000100:00100000:1.0:1788642342.572437:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086478336 00000100:00100000:1.0:1788642342.572455:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086478336 00000100:00100000:1.0:1788642342.572543:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 306 00000100:00100000:1.0:1788642342.572554:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086478336:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642342.572621:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9684ea0b-8125-4caf-b771-9063c6354463+13:2360:x1875527086478336:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 70us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642342.572628:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 306 00000100:00080000:0.0:1788642342.573964:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788642342.573977:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642342.573981:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788642342.842753:0:11714:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788642342.842772:0:11714:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642342.843371:0:11714:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788642342.843380:0:11714:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788642342.847797:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642343.359745:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642343.359870:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086479104 00000100:00100000:2.0:1788642343.359882:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086479104 00000100:00100000:2.0:1788642343.360010:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:2.0:1788642343.360022:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+18:12339:x1875527086479104:12345-192.168.202.49@tcp:35:umount.0 00000100:00100000:2.0:1788642343.360491:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:12339:x1875527086479104:12345-192.168.202.49@tcp:35:umount.0 Request processed in 468us (754us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788642343.360499:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 66 00000100:00100000:3.0:1788642343.368387:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642343.375463:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086479360 00000100:00100000:0.0:1788642343.375480:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086479360 00000100:00100000:0.0:1788642343.375552:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 67 00000100:00100000:0.0:1788642343.375563:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+19:12339:x1875527086479360:12345-192.168.202.49@tcp:35:umount.0 00000100:00100000:0.0:1788642343.376023:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:12339:x1875527086479360:12345-192.168.202.49@tcp:35:umount.0 Request processed in 461us (7650us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788642343.376032:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 67 00000100:00100000:1.0:1788642343.395446:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642343.395553:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086479616 00000100:00100000:0.0:1788642343.395567:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086479616 00000100:00100000:0.0:1788642343.395639:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:0.0:1788642343.395650:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddddbdc8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+20:12339:x1875527086479616:12345-192.168.202.49@tcp:35:umount.0 00000100:00100000:0.0:1788642343.395899:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddddbdc8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:12339:x1875527086479616:12345-192.168.202.49@tcp:35:umount.0 Request processed in 250us (1170us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788642343.395908:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 68 00000100:00100000:1.0:1788642343.420488:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642343.420757:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086479872 00000100:00100000:0.0:1788642343.420775:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086479872 00000100:00100000:0.0:1788642343.420868:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:0.0:1788642343.420881:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:12339:x1875527086479872:12345-192.168.202.49@tcp:35:umount.0 00000100:00100000:0.0:1788642343.422805:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:12339:x1875527086479872:12345-192.168.202.49@tcp:35:umount.0 Request processed in 1914us (2318us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788642343.422818:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 69 00000100:00100000:3.0:1788642343.432336:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642343.432768:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642343.435889:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642343.438282:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086480000 00000100:00100000:0.0:1788642343.438303:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086480000 00000100:00100000:0.0:1788642343.438515:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086480256 00000100:00100000:0.0:1788642343.438519:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086480256 00000100:00100000:3.0:1788642343.447490:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642343.447559:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086480640 00000100:00100000:3.0:1788642343.447569:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086480640 00000100:00100000:3.0:1788642343.447648:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 72 00000100:00100000:3.0:1788642343.447661:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+7:2358:x1875527086480640:12345-192.168.202.49@tcp:9:umount.0 00000020:00000080:3.0:1788642343.447709:0:6711:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d709 00000020:00010000:3.0:1788642343.447724:0:6711:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dddf7f24000: total 0 00000100:00080000:3.0:1788642343.447739:0:6711:0:(import.c:65:import_set_state_nolock()) ffff8dddf7f26000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788642343.447799:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788642343.448178:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2358:x1875527086480640:12345-192.168.202.49@tcp:9:umount.0 Request processed in 519us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642343.448187:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 72 00000020:00010000:3.0:1788642343.448219:0:5849:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dddf7f24000: total 0 00010000:00010000:3.0:1788642343.448242:0:5849:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dddf7f24000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788642343.448306:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddbe9801/0x4ae1ee156666daa5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9953 expref: 4 pid: 9442 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.448342:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005a07ef4/0x4ae1ee156666e143 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b21 expref: 3 pid: 6712 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.448391:0:5849:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dddf7f24000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788642343.448404:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642343.448406:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642343.448408:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642343.451917:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086480128 00000100:00100000:1.0:1788642343.451936:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086480128 00000100:00100000:1.0:1788642343.452052:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:1.0:1788642343.452077:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9684ea0b-8125-4caf-b771-9063c6354463+15:2361:x1875527086480000:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642343.452134:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642343.452160:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddd6121400/0x4ae1ee156666d1c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96b3 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642343.452179:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642343.452276:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9684ea0b-8125-4caf-b771-9063c6354463+14:2361:x1875527086480000:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 213us (19952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642343.452284:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:1.0:1788642343.452304:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:1.0:1788642343.452310:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9684ea0b-8125-4caf-b771-9063c6354463+13:2361:x1875527086480256:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642343.452318:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642343.452329:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddcfb51a00/0x4ae1ee156666d3b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a977e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642343.452337:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642343.452354:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9684ea0b-8125-4caf-b771-9063c6354463+12:2361:x1875527086480256:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 44us (19589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642343.452360:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:1.0:1788642343.452372:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:1.0:1788642343.452378:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9684ea0b-8125-4caf-b771-9063c6354463+11:2361:x1875527086480128:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642343.452385:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642343.452395:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9832600/0x4ae1ee156666d12f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a967b expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642343.452403:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642343.452419:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9684ea0b-8125-4caf-b771-9063c6354463+10:2361:x1875527086480128:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 42us (16548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642343.452465:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:3.0:1788642343.459651:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642343.459769:0:9442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086480768 00000100:00100000:1.0:1788642343.459782:0:9442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086480768 00000100:00100000:1.0:1788642343.459844:0:9442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 73 00000100:00100000:1.0:1788642343.459854:0:9442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+5:2358:x1875527086480768:12345-192.168.202.49@tcp:9:umount.0 00000020:00000080:1.0:1788642343.459888:0:9442:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d4a1 00000100:00080000:1.0:1788642343.459898:0:9442:0:(import.c:65:import_set_state_nolock()) ffff8dddfaee5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788642343.459942:0:9442:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788642343.460252:0:9442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e32b659c-dd8d-40c5-94b4-b9b0e719a356+2:2358:x1875527086480768:12345-192.168.202.49@tcp:9:umount.0 Request processed in 398us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642343.460261:0:9442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 73 00010000:00010000:1.0:1788642343.460286:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642343.479534:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642343.480190:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086481792 00000100:00100000:2.0:1788642343.480202:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086481792 00000100:00100000:2.0:1788642343.480293:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 240 00000100:00100000:2.0:1788642343.480306:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+22:2358:x1875527086481792:12345-192.168.202.49@tcp:39:umount.0 00000020:00000080:2.0:1788642343.480349:0:5863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d13d 00000020:00010000:2.0:1788642343.480367:0:5863:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ddcc65cb000: total 0 00000100:00080000:2.0:1788642343.480374:0:5863:0:(import.c:65:import_set_state_nolock()) ffff8dddeff07800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788642343.480410:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1788642343.480893:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e32b659c-dd8d-40c5-94b4-b9b0e719a356+21:2358:x1875527086481792:12345-192.168.202.49@tcp:39:umount.0 Request processed in 589us (1372us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788642343.480902:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 240 00000020:00010000:3.0:1788642343.481359:0:5848:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ddcc65cb000: total 0 00010000:00010000:3.0:1788642343.481417:0:5848:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ddcc65cb000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788642343.481460:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642343.481464:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788642343.481473:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666d986 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9906 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481492:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:3.0:1788642343.481495:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642343.481500:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e104 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b0c expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481515:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365ff00) 00010000:00010000:3.0:1788642343.481518:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788642343.481522:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51000/0x4ae1ee156666db07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a996f expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481535:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365f900) 00010000:00010000:3.0:1788642343.481538:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642343.481542:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50200/0x4ae1ee156666d423 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9793 expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481588:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642343.481591:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642343.481595:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50c00/0x4ae1ee156666da66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a993e expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481610:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ddde00fbe00) 00010000:00010000:3.0:1788642343.481613:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788642343.481617:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6120200/0x4ae1ee156666d407 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a978c expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481634:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ddde02b5000) 00010000:00010000:3.0:1788642343.481637:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788642343.481640:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031200/0x4ae1ee156666da90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a994c expref: 14 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481658:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:3.0:1788642343.481660:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788642343.481664:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab800/0x4ae1ee156666e12e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b1a expref: 13 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481675:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dddc2c20000) 00010000:00010000:3.0:1788642343.481678:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788642343.481681:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa800/0x4ae1ee156666e024 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ad4 expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481694:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:3.0:1788642343.481696:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788642343.481707:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb50400/0x4ae1ee156666d764 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a987a expref: 11 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481720:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:3.0:1788642343.481722:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788642343.481725:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddcfb51e00/0x4ae1ee156666db23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9976 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481735:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dddc365fb00) 00010000:00010000:3.0:1788642343.481737:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788642343.481740:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaba00/0x4ae1ee156666de02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9a48 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481754:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ddde02b5a00) 00010000:00010000:3.0:1788642343.481757:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788642343.481761:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddc0031e00/0x4ae1ee156666d477 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a97a8 expref: 8 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642343.481774:0:5848:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ddcc65cb000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788642343.481788:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642343.481791:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642343.481792:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642343.610595:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107433600:0@lo:400:kworker.0 00000100:00100000:0.0:1788642343.610675:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642343.610755:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642343.610762:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107433728:0@lo:400:kworker.0 00000100:00100000:0.0:1788642343.610810:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642343.612484:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107433600 00000100:00100000:1.0:1788642343.612501:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107433600 00000100:00100000:1.0:1788642343.612598:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788642343.612612:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107433600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642343.612735:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107433600:12345-0@lo:400:kworker.0 Request processed in 127us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642343.612743:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788642343.612870:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc5dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107433344:0@lo:400:kworker.0 00000100:00100000:2.0:1788642343.612928:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642343.613003:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107433856:0@lo:400:kworker.0 00000100:00100000:2.0:1788642343.613033:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642343.613067:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788642343.613074:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107433472:0@lo:400:kworker.0 00000100:00100000:2.0:1788642343.613170:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642343.613193:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107433984:0@lo:400:kworker.0 00000100:00100000:2.0:1788642343.613234:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642343.613280:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107433856 00000100:00100000:2.0:1788642343.613286:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107433856 00000100:00100000:2.0:1788642343.613320:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107433472 00000100:00100000:2.0:1788642343.613323:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107433472 00000100:00100000:2.0:1788642343.613337:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788642343.613344:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107433856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642343.613390:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107433856:12345-0@lo:400:kworker.0 Request processed in 46us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642343.613397:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788642343.613412:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788642343.613417:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107433472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642343.613459:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107433472:12345-0@lo:400:kworker.0 Request processed in 42us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642343.613465:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788642343.613509:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107433472:0@lo:400:kworker.0 00000100:00100000:2.0:1788642343.613519:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc64f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107433856:0@lo:400:kworker.0 00000100:00100000:3.0:1788642343.614047:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107433728 00000100:00100000:3.0:1788642343.614053:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107433728 00000100:00100000:3.0:1788642343.614141:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107433984 00000100:00100000:3.0:1788642343.614145:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107433984 00000100:00100000:3.0:1788642343.614174:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788642343.614184:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107433728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642343.614242:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107433728:12345-0@lo:400:kworker.0 Request processed in 62us (3432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642343.614259:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788642343.614273:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788642343.614280:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107433984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642343.614319:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107433984:12345-0@lo:400:kworker.0 Request processed in 40us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642343.614326:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1788642343.614662:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642343.614668:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788642343.614672:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642343.614726:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107433728:0@lo:400:kworker.0 00000100:00100000:0.0:1788642343.614742:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107433600:0@lo:400:kworker.0 00000100:00100000:1.0:1788642343.614856:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107433344 00000100:00100000:1.0:1788642343.614861:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107433344 00000100:00100000:1.0:1788642343.614903:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788642343.614912:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107433344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642343.614967:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3317:x1875527107433344:12345-0@lo:400:kworker.0 Request processed in 46us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642343.614985:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788642343.616839:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107433984:0@lo:400:kworker.0 00000100:00100000:2.0:1788642343.616854:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc5dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107433344:0@lo:400:kworker.0 00010000:00010000:3.0:1788642343.866599:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642344.123135:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788642344.123159:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107434112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642344.123229:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642344.123390:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107434112 00000100:00100000:3.0:1788642344.123410:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107434112 00000100:00100000:3.0:1788642344.123479:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788642344.123489:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107434112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642344.123533:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642344.123593:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107434112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642344.123601:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788642344.123743:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107434112:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788642344.707411:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000020:00000080:2.0:1788642344.707421:0:7669:0:(genops.c:885:class_export_put()) final put ffff8dddf7f24000/e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000020:00000080:2.0:1788642344.707456:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddf7f24000/e32b659c-dd8d-40c5-94b4-b9b0e719a356 for lustre-OST0001 00000020:00000080:2.0:1788642344.707509:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddf7f26000 for lustre-OST0001 00000001:00080000:0.0:1788642344.726620:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1788642344.726646:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000001:00080000:0.0:1788642344.726654:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788642344.726660:0:5883:0:(genops.c:885:class_export_put()) final put ffff8ddcc65cb000/e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000020:00000080:0.0:1788642344.726688:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc65cb000/e32b659c-dd8d-40c5-94b4-b9b0e719a356 for lustre-MDT0000 00000020:00000080:0.0:1788642344.726771:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddeff07800 for lustre-MDT0000 00000001:00100000:3.0:1788642344.768477:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000020:00000080:3.0:1788642344.768487:0:6736:0:(genops.c:885:class_export_put()) final put ffff8dddfaee0800/e32b659c-dd8d-40c5-94b4-b9b0e719a356 00000020:00000080:2.0:1788642344.768782:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfaee0800/e32b659c-dd8d-40c5-94b4-b9b0e719a356 for lustre-OST0000 00000020:00000080:2.0:1788642344.768865:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddfaee5000 for lustre-OST0000 00010000:00010000:1.0:1788642344.891025:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642345.147879:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642345.147909:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107434240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642345.147990:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642345.148218:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107434240 00000100:00100000:3.0:1788642345.148227:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107434240 00000100:00100000:3.0:1788642345.148301:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788642345.148312:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107434240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642345.148361:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642345.148421:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107434240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642345.148429:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788642345.148642:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107434240:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788642345.151981:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642345.444706:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642345.444770:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642345.444809:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642345.444917:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086482048 00000100:00100000:0.0:1788642345.444928:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086482048 00000100:00100000:0.0:1788642345.444990:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086481920 00000100:00100000:0.0:1788642345.444994:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086481920 00000100:00100000:0.0:1788642345.445005:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086482176 00000100:00100000:0.0:1788642345.445007:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086482176 00000100:00100000:0.0:1788642345.445024:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:0.0:1788642345.445033:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+12:2361:x1875527086482048:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642345.445047:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642345.445065:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9833a00/0x4ae1ee156666d216 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96f2 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642345.445096:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642345.445223:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+11:2361:x1875527086482048:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 191us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642345.445231:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:0.0:1788642345.445248:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:0.0:1788642345.445254:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+10:2361:x1875527086481920:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642345.445261:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642345.445270:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfd6e0200/0x4ae1ee156666d20f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96c8 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642345.445280:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642345.445295:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+9:2361:x1875527086481920:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 42us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642345.445301:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:0.0:1788642345.445313:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:0.0:1788642345.445319:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+8:2361:x1875527086482176:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642345.445327:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642345.445335:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddcfb51400/0x4ae1ee156666d3ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9777 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642345.445354:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642345.445371:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9684ea0b-8125-4caf-b771-9063c6354463+7:2361:x1875527086482176:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 52us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642345.445377:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:1.0:1788642345.451309:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642345.451407:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086482432 00000100:00100000:2.0:1788642345.451419:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086482432 00000100:00080000:0.0:1788642345.451462:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642345.451513:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 241 00000100:00100000:2.0:1788642345.451526:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+6:2358:x1875527086482432:12345-192.168.202.49@tcp:39:umount.0 00000020:00000080:2.0:1788642345.451569:0:5863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d224 00000020:00010000:2.0:1788642345.451579:0:5863:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dddef7fd000: total 0 00000100:00080000:2.0:1788642345.451584:0:5863:0:(import.c:65:import_set_state_nolock()) ffff8dddef7f9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788642345.451620:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1788642345.451632:0:5848:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dddef7fd000: total 0 00010000:00010000:3.0:1788642345.451638:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642345.451692:0:5848:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dddef7fd000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788642345.451731:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365ff00) 00010000:00010000:3.0:1788642345.451735:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788642345.451744:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba400/0x4ae1ee156666e151 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b28 expref: 5 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642345.451777:0:5848:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dddef7fd000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788642345.451790:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642345.451792:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642345.451794:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642345.452076:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:86cdb3bb-d6ab-4ce8-8678-57c02fc622f5+3:2358:x1875527086482432:12345-192.168.202.49@tcp:39:umount.0 Request processed in 553us (779us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788642345.452085:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 241 00000100:00100000:1.0:1788642345.469645:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642345.469753:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086482688 00000100:00100000:2.0:1788642345.469764:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086482688 00000100:00100000:2.0:1788642345.469822:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 308 00000100:00100000:2.0:1788642345.469841:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+7:2358:x1875527086482688:12345-192.168.202.49@tcp:251:umount.0 00000020:00000080:2.0:1788642345.469911:0:5856:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d11a 00000020:00010000:2.0:1788642345.469918:0:5856:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dddef7fa800: total 0 00000100:00080000:2.0:1788642345.469923:0:5856:0:(import.c:65:import_set_state_nolock()) ffff8dddef7ff800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788642345.470036:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9684ea0b-8125-4caf-b771-9063c6354463+3:2358:x1875527086482688:12345-192.168.202.49@tcp:251:umount.0 Request processed in 204us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642345.470045:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 308 00000020:00010000:3.0:1788642345.474266:0:5849:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dddef7fa800: total 0 00010000:00010000:3.0:1788642345.474376:0:5849:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dddef7fa800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788642345.474423:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f9400/0x4ae1ee156666d1d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a96ba expref: 2 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642345.474447:0:5849:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dddef7fa800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788642345.474458:0:5849:0:(genops.c:885:class_export_put()) final put ffff8dddef7fa800/9684ea0b-8125-4caf-b771-9063c6354463 00010000:00010000:3.0:1788642345.474489:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642345.474492:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642345.474494:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788642345.475376:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddef7fa800/9684ea0b-8125-4caf-b771-9063c6354463 for MGS 00000020:00000080:1.0:1788642345.475428:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddef7ff800 for MGS 00010000:00010000:1.0:1788642345.917131:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642346.938360:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788642347.146873:0:12993:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788642347.166319:0:12993:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788642347.166386:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642347.166403:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642347.166411:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642347.166419:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642347.166449:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788642347.166456:0:12993:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788642347.166485:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788642347.166490:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788642347.166498:0:12993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788642347.166531:0:12993:0:(import.c:65:import_set_state_nolock()) ffff8dddfb5d4800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788642347.166686:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875527107434368:0@lo:39:umount.0 00000100:00100000:1.0:1788642347.166806:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788642347.168063:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642347.168077:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.168088:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9832400 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642347.168137:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.168148:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788642347.168154:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642347.168162:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788642347.168165:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788642347.168168:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788642347.168220:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.168227:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642347.168274:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.168282:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddc9832400/0x4ae1ee156666d19f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d1a6 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.168300:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642347.168303:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642347.168305:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642347.168405:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788642347.168432:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107434496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788642347.168523:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642347.168897:0:9441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107434368 00000100:00100000:0.0:1788642347.168907:0:9441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107434368 00000100:00100000:0.0:1788642347.169162:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788642347.169173:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875527107434368:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788642347.169387:0:9441:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666cf29 00000100:00080000:0.0:1788642347.169557:0:9441:0:(import.c:65:import_set_state_nolock()) ffff8dddfb4da000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788642347.169615:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642347.169663:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3316:x1875527107434368:12345-0@lo:39:umount.0 Request processed in 491us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642347.169671:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1788642347.169682:0:9441:0:(genops.c:885:class_export_put()) final put ffff8dddfb4d8800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1788642347.169720:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107434496 00000100:00100000:0.0:1788642347.169726:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107434496 00000100:00080000:1.0:1788642347.169898:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddfb5d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788642347.169917:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875527107434368:0@lo:39:umount.0 00000100:00100000:0.0:1788642347.169935:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788642347.169943:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7e7e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3318:x1875527107434496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642347.169956:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642347.169977:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f9000/0x4ae1ee156666d1a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666d19f expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.169992:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642347.170036:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7e7e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:3318:x1875527107434496:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642347.170042:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788642347.170046:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788642347.170050:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788642347.170055:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788642347.170069:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfb4d8800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788642347.170216:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddfb4da000 for lustre-MDT0000 00000100:00100000:1.0:1788642347.171137:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107434496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642347.173283:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173320:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173329:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173359:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173396:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642347.173404:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173411:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173417:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173424:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173441:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788642347.173448:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173455:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173461:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173465:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788642347.173467:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173472:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173489:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833000 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642347.173493:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173495:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788642347.173501:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f8000/0x4ae1ee156666ce88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173502:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173508:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f8000/0x4ae1ee156666ce88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788642347.173511:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173514:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dde021f8000/0x4ae1ee156666ce88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642347.173517:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788642347.173519:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788642347.173520:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dde021f8000/0x4ae1ee156666ce88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642347.173525:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788642347.173529:0:12993:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788642347.173538:0:12993:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788642347.173564:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173569:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:0.0:1788642347.173593:0:12993:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788642347.173599:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:3.0:1788642347.173601:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788642347.173605:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1788642347.173608:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddc9833000/0x4ae1ee156666d1ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d1b4 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788642347.173611:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000100:00100000:2.0:1788642347.173620:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:0.0:1788642347.173622:0:12993:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dddeff00000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1788642347.173623:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788642347.173627:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788642347.173628:0:12993:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dddfb4d8000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1788642347.173633:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833e00 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642347.173636:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788642347.173639:0:12993:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8dddef7fd000 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 192.168.202.49@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788642347.173646:0:12993:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8dddc5a30000) has exports, disconnecting them 00000020:00080000:0.0:1788642347.173652:0:12993:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dddeff00000), last request at 1788642343 00010000:00010000:3.0:1788642347.173655:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788642347.173660:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d09c 10000000:00010000:3.0:1788642347.173662:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642347.173668:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788642347.173671:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:2.0:1788642347.173671:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107434624:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1788642347.173673:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:0.0:1788642347.173681:0:12993:0:(import.c:65:import_set_state_nolock()) ffff8dddeff01000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788642347.173690:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173695:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642347.173712:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173720:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddc9833e00/0x4ae1ee156666d0d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d0db expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173735:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:0.0:1788642347.173737:0:12993:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dddeff00000): rc 0 00010000:00010000:3.0:1788642347.173739:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788642347.173740:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddeff00000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1788642347.173745:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9c00 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642347.173748:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788642347.173751:0:12993:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dddfb4d8000), last request at 1788642343 00000020:00000080:0.0:1788642347.173754:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666cfd1 00010000:00010000:3.0:1788642347.173756:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788642347.173760:0:12993:0:(import.c:65:import_set_state_nolock()) ffff8dddfb4db000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788642347.173767:0:12993:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dddfb4d8000): rc 0 00000020:00000080:0.0:1788642347.173769:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddfb4d8000/lustre-MDT0000-lwp-OST0000_UUID 10000000:00010000:3.0:1788642347.173772:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642347.173777:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000004:00000080:0.0:1788642347.173777:0:12993:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa3a441cd7ae0 10000000:01000000:3.0:1788642347.173779:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788642347.173781:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1788642347.173791:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788642347.173795:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173802:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642347.173810:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788642347.173811:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788642347.173815:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:3.0:1788642347.173817:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dde021f9c00/0x4ae1ee156666d3d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d3dd expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173831:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642347.173835:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dde021f8000/0x4ae1ee156666ce88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173840:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f8000 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642347.173843:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dde021f8000/0x4ae1ee156666ce88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173850:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dde021f8000/0x4ae1ee156666ce88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642347.173855:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107434752:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1788642347.173858:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dde021f8000/0x4ae1ee156666ce88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642347.173876:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788642347.173879:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788642347.173881:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1788642347.173888:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642347.173911:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788642347.173913:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dde021f8000/0x4ae1ee156666ce88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642347.173919:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107434880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788642347.173925:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642347.173938:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dde021f8000/0x4ae1ee156666ce88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642347.173944:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dde021f8000/0x4ae1ee156666ce88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666ce8f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642347.173950:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788642347.173965:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642347.173967:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642347.173970:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642347.173979:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788642347.173991:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107435008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788642347.173996:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107434624 00000100:00100000:2.0:1788642347.174003:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107434624 00000100:00100000:3.0:1788642347.174025:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642347.174043:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107434752 00000100:00100000:2.0:1788642347.174048:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107434752 00000100:00100000:2.0:1788642347.174061:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107434880 00000100:00100000:2.0:1788642347.174064:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107434880 00000100:00100000:2.0:1788642347.174072:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107435008 00000100:00100000:2.0:1788642347.174074:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107435008 00000100:00100000:2.0:1788642347.174087:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788642347.174096:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+21:3317:x1875527107434624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788642347.174130:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642347.174144:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f8400/0x4ae1ee156666d1b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666d1ad expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642347.174159:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642347.174191:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+20:3317:x1875527107434624:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642347.174197:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788642347.174212:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788642347.174219:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+19:3319:x1875527107434752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788642347.174226:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642347.174239:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9832e00/0x4ae1ee156666d0db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666d0d4 expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642347.174250:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642347.174299:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+18:3319:x1875527107434752:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642347.174306:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788642347.174319:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788642347.174324:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+17:3319:x1875527107434880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788642347.174332:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642347.174340:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddd6121a00/0x4ae1ee156666d3dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666d3d6 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642347.174350:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642347.174370:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+16:3319:x1875527107434880:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642347.174376:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788642347.174387:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788642347.174393:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+15:3318:x1875527107435008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788642347.174400:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642347.174407:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddcfb51c00/0x4ae1ee156666ce8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666ce88 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642347.174422:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642347.174453:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:3318:x1875527107435008:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642347.174459:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107434880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788642347.174464:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788642347.174480:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae59d524-c809-4baa-a38f-29c60bd72e4e:3319:1875527107434752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788642347.174494:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788642347.174512:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddeff00000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788642347.174561:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfb4d8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:1.0:1788642347.174569:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788642347.174590:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddeff01000 for lustre-MDT0000 00000020:00000080:2.0:1788642347.174595:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddfb4db000 for lustre-MDT0000 00000100:00100000:2.0:1788642347.174618:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107434624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788642347.174655:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107435008:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1788642347.177079:0:12993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788642347.177167:0:12993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788642347.177215:0:12993:0:(import.c:65:import_set_state_nolock()) ffff8ddcc7102000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788642347.177270:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788642347.177276:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788642347.177289:0:12993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788642347.177364:0:12993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788642347.177375:0:12993:0:(import.c:65:import_set_state_nolock()) ffff8ddcc533c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788642347.177428:0:12993:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8dddc5a30000) has no exports 00000100:00100000:3.0:1788642347.178255:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107435136:0@lo:9:umount.0 00000100:00100000:3.0:1788642347.178373:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642347.178414:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107435264:0@lo:9:umount.0 00000100:00100000:3.0:1788642347.178435:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642347.178467:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107435136 00000100:00100000:0.0:1788642347.178481:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107435136 00000100:00100000:3.0:1788642347.178520:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107435264 00000100:00100000:3.0:1788642347.178541:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107435264 00000100:00100000:0.0:1788642347.178567:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788642347.178572:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788642347.178577:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875527107435136:12345-0@lo:9:umount.0 00000100:00100000:3.0:1788642347.178578:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1875527107435264:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788642347.178610:0:6709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d105 00000020:00000080:0.0:1788642347.178610:0:6712:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d01e 00000100:00080000:3.0:1788642347.178621:0:6709:0:(import.c:65:import_set_state_nolock()) ffff8dddff6b4000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788642347.178621:0:6712:0:(import.c:65:import_set_state_nolock()) ffff8dddefa29000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788642347.178666:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788642347.179511:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3316:x1875527107435136:12345-0@lo:9:umount.0 Request processed in 927us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642347.179525:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788642347.179579:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642347.179586:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788642347.179788:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8ddcc7102000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788642347.179807:0:3316:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788642347.179809:0:3316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788642347.179813:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107435136:0@lo:9:umount.0 00000001:00000004:3.0:1788642347.183177:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788642347.183621:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3316:x1875527107435264:12345-0@lo:9:umount.0 Request processed in 5036us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642347.183633:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788642347.183698:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8ddcc533c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788642347.183711:0:3316:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788642347.183714:0:3316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788642347.183719:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107435264:0@lo:9:umount.0 00010000:00010000:0.0:1788642347.183997:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642347.188230:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788642347.193395:0:12993:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8dddc5a30000) has no exports 00000020:00000080:0.0:1788642347.268706:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666cee3 00000020:00000080:0.0:1788642347.268731:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddfd7e7000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788642347.268755:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788642347.268800:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfd7e7000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788642347.268971:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788642347.268983:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788642347.268987:0:12993:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8dddfd7dcd40) has no exports 00000020:00000080:1.0:1788642347.270782:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666cedc 00000020:00000080:1.0:1788642347.270815:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddfd7cd000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788642347.270953:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788642347.270965:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788642347.270968:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddfd7cf800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788642347.270971:0:12993:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfd7cf800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788642347.270980:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788642347.271183:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfd7cd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788642347.962554:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642348.731057:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107435392:0@lo:400:kworker.0 00000100:00100000:1.0:1788642348.731167:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642348.731311:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107435520:0@lo:400:kworker.0 00000100:00100000:3.0:1788642348.731354:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642348.731386:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642348.731403:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107435648:0@lo:400:kworker.0 00000100:00100000:1.0:1788642348.731427:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107435520 00000100:00100000:3.0:1788642348.731432:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642348.731444:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107435520 00000100:00100000:1.0:1788642348.731521:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107435648 00000100:00100000:1.0:1788642348.731527:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107435648 00000100:00100000:1.0:1788642348.731561:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788642348.731575:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3319:x1875527107435520:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788642348.731588:0:5862:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788642348.731640:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3319:x1875527107435520:12345-0@lo:400:kworker.0 Request processed in 66us (284us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788642348.731647:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788642348.731658:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1875527107435648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642348.731658:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000020:00080000:3.0:1788642348.731667:0:5861:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788642348.731700:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1875527107435648:12345-0@lo:400:kworker.0 Request processed in 45us (270us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788642348.731707:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1788642348.731743:0:3319:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788642348.731764:0:3319:0:(import.c:65:import_set_state_nolock()) ffff8ddcc65ca800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788642348.731769:0:3319:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788642348.732272:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107435392 00000100:00100000:0.0:1788642348.732280:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107435392 00000100:00100000:0.0:1788642348.732338:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788642348.732346:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc5a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:3318:x1875527107435392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642348.732420:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc5a15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae59d524-c809-4baa-a38f-29c60bd72e4e+14:3318:x1875527107435392:12345-0@lo:400:kworker.0 Request processed in 74us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642348.732426:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788642348.732476:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107435392:0@lo:400:kworker.0 00000100:00080000:3.0:1788642348.750284:0:3319:0:(import.c:65:import_set_state_nolock()) ffff8ddcc65ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788642348.750306:0:3319:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 230 00000100:00080000:3.0:1788642348.750322:0:3319:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ddcc65ca800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788642348.750405:0:3319:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfb40ca80 x1875527107435776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788642348.750519:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1875527107435776:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788642348.750656:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642348.750757:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107435648:0@lo:400:kworker.0 00000100:00080000:3.0:1788642348.750810:0:3319:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788642348.750815:0:3319:0:(import.c:65:import_set_state_nolock()) ffff8ddcc5338000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788642348.750819:0:3319:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788642348.750824:0:3319:0:(import.c:65:import_set_state_nolock()) ffff8ddcc5338000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788642348.750827:0:3319:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 210 00000100:00080000:3.0:1788642348.750833:0:3319:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ddcc5338000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788642348.750868:0:3319:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfb40e680 x1875527107435904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788642348.750883:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107435520:0@lo:400:kworker.0 00000100:00100000:0.0:1788642348.751059:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1875527107435904:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788642348.751088:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642348.753020:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107435776 00000100:00100000:2.0:1788642348.753198:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107435776 00000100:00100000:2.0:1788642348.753293:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107435904 00000100:00100000:2.0:1788642348.753297:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107435904 00000100:00100000:3.0:1788642348.753370:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788642348.753385:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1875527107435776:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788642348.753427:0:5861:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788642348.762174:0:9441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788642348.762196:0:9441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3316:x1875527107435904:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788642348.762231:0:9441:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788642348.762394:0:9441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3316:x1875527107435904:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 199us (11304us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788642348.762413:0:9441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1788642348.762900:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8ddcc5338000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788642348.762912:0:3316:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788642348.762917:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1875527107435904:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788642348.772153:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1875527107435776:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 18754us (21482us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788642348.772174:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1788642348.772352:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8ddcc65ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788642348.772359:0:3316:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788642348.772364:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1875527107435776:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1788642348.986396:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788642349.849667:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788642349.849678:0:7669:0:(genops.c:885:class_export_put()) final put ffff8ddcc533a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788642349.849706:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc533a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788642349.849745:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddff6b4000 for lustre-OST0001 00000001:00100000:1.0:1788642349.851496:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788642349.851504:0:6736:0:(genops.c:885:class_export_put()) final put ffff8dddff6b2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788642349.851782:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddff6b2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788642349.851830:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddefa29000 for lustre-OST0000 00000001:00100000:0.0:1788642349.870215:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 00000001:00080000:0.0:1788642349.870246:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788642349.870252:0:5883:0:(genops.c:885:class_export_put()) final put ffff8dddef7fd000/86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 00000020:00000080:3.0:1788642349.870414:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddef7fd000/86cdb3bb-d6ab-4ce8-8678-57c02fc622f5 for lustre-MDT0000 00000020:00000080:3.0:1788642349.870513:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddef7f9000 for lustre-MDT0000 00010000:00010000:1.0:1788642350.014025:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642351.034933:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642352.058391:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642353.082592:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788642353.338647:0:12993:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ddde4e609c0 - data ffff8dddebbfaaf8/ffff8dddfb177400 00000020:01000000:1.0:1788642353.338840:0:12993:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dddc739d120 - data ffff8dddeb85ce58/ffff8dddef18b400 00000001:00000004:1.0:1788642353.350908:0:12993:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788642353.472166:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788642353.472185:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788642353.472218:0:12993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788642353.472222:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788642353.472835:0:7033:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788642353.472843:0:7033:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788642353.472857:0:7033:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788642353.476281:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788642353.476292:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788642353.476316:0:12993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788642353.476319:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788642353.476690:0:7960:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788642353.476696:0:7960:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788642353.476709:0:7960:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788642353.539719:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666ceab 00000020:00000080:1.0:1788642353.539738:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddfb5bf000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788642353.542365:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666cec0 00000020:00000080:1.0:1788642353.542386:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddfb5d5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788642353.542768:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfb5bf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788642353.542856:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788642353.542864:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788642353.542876:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788642353.542881:0:12993:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8dddc5a319c0) has no exports 00000004:01000000:1.0:1788642353.543093:0:12993:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788642353.543189:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfb5d5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788642353.543261:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d0fe 00000020:00000080:1.0:1788642353.543271:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddef7ff000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788642353.543315:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788642353.543321:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788642353.543330:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788642353.543333:0:12993:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8dddeff40000) has no exports 00000020:00000080:1.0:1788642353.543342:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d0f7 00000020:00000080:1.0:1788642353.543347:0:12993:0:(genops.c:885:class_export_put()) final put ffff8ddcc533b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788642353.543674:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddef7ff000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788642353.544285:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc533b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788642353.544824:0:12993:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788642353.544830:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788642353.544836:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788642353.544845:0:12993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788642353.544847:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788642353.544905:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788642353.544919:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788642353.544928:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d017 00000020:00000080:0.0:1788642353.544937:0:12993:0:(genops.c:885:class_export_put()) final put ffff8ddcc5339000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788642353.544946:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788642353.544951:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788642353.544956:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788642353.544960:0:12993:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dddfa7c19c0) has no exports 00000020:00000080:0.0:1788642353.544966:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d010 00000020:00000080:0.0:1788642353.544969:0:12993:0:(genops.c:885:class_export_put()) final put ffff8ddcc7106000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788642353.545410:0:12993:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788642353.545414:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788642353.545417:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788642353.545421:0:12993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788642353.545423:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788642353.545454:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788642353.545459:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788642353.545497:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788642353.545500:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788642353.545504:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddfb5bd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788642353.545507:0:12993:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfb5bd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788642353.545520:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788642353.545924:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666cec7 00000020:00000080:0.0:1788642353.545933:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddfb5d7800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788642353.545938:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788642353.545942:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788642353.545959:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788642353.545962:0:12993:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8dddc5a33380) has no exports 00000020:00000080:0.0:1788642353.545987:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788642353.545990:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788642353.545994:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666cece 00000020:00000080:0.0:1788642353.545998:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddfb5d3000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788642353.546011:0:12993:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dddc599b800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788642353.546015:0:12993:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dddc599b800 3 00000020:01000004:0.0:1788642353.546019:0:12993:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dddc599b800 from lustre-MDT0000 00000020:00000080:0.0:1788642353.546041:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788642353.546045:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788642353.546048:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddfb5b9000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788642353.546051:0:12993:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfb5b9000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788642353.546060:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788642353.546086:0:12993:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788642353.546090:0:12993:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788642353.546093:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788642353.546095:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788642353.546132:0:12993:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788642353.546141:0:12993:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dddc5a39800 ae59d524-c809-4baa-a38f-29c60bd72e4e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788642353.546147:0:12993:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8dddc5a34d40) has exports, disconnecting them 00000020:00080000:0.0:1788642353.546153:0:12993:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dddc5a39800), last request at 1788642105 00000020:00000080:0.0:1788642353.546173:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666ce6c 00000020:00010000:0.0:1788642353.546178:0:12993:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dddc5a39800: total 4 00000100:00080000:0.0:1788642353.546183:0:12993:0:(import.c:65:import_set_state_nolock()) ffff8dddc5a3d000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788642353.546201:0:12993:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dddc5a39800): rc 0 00000020:00080000:0.0:1788642353.546205:0:12993:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dddc5a34d40) has no exports 00000100:00100000:0.0:1788642353.546287:0:5853:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dddc63b5000:5853] 0 exiting: rc = 1 00000020:00010000:1.0:1788642353.546478:0:5848:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dddc5a39800: total 4 00010000:00010000:1.0:1788642353.546525:0:5848:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dddc5a39800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788642353.546573:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666d3c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666d3ba expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642353.546591:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f8e00/0x4ae1ee156666d3cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666d3c8 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642353.546616:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9832800/0x4ae1ee156666cf84 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666cf7d expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642353.546630:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddd6120400/0x4ae1ee156666d1c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666d1bb expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642353.546643:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f9200/0x4ae1ee156666d16e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666d167 expref: 5 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642353.546655:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddc9832c00/0x4ae1ee156666d17c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666d175 expref: 4 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642353.546666:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f8c00/0x4ae1ee156666d18a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666d183 expref: 3 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642353.546677:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dde021f9600/0x4ae1ee156666d198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4ae1ee156666d191 expref: 2 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642353.546687:0:5848:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dddc5a39800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788642353.546698:0:5848:0:(genops.c:885:class_export_put()) final put ffff8dddc5a39800/ae59d524-c809-4baa-a38f-29c60bd72e4e 00010000:00010000:1.0:1788642353.546705:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642353.546707:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642353.546709:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642353.546746:0:5854:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dddc7ec5a00:5854] 1 exiting: rc = 0 00000100:00100000:1.0:1788642353.546820:0:5856:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dddc59b4000:5856] 2 exiting: rc = 0 00000020:00000080:2.0:1788642353.547032:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ddcc533c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788642353.547043:0:8:0:(genops.c:885:class_export_put()) final put ffff8ddcc58d4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788642353.547046:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc58d4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788642353.547052:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788642353.547154:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc5339000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788642353.547161:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc7106000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788642353.547166:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ddcc7102000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788642353.547171:0:8:0:(genops.c:885:class_export_put()) final put ffff8ddcc4917000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788642353.547174:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc4917000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788642353.547177:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788642353.547261:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfb5d7800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788642353.547266:0:8:0:(genops.c:885:class_export_put()) final put ffff8dddfb5d6000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788642353.547268:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfb5d6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788642353.547271:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788642353.547458:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfb5d3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788642353.547463:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddc5a39800/ae59d524-c809-4baa-a38f-29c60bd72e4e for MGS 00000020:00000080:2.0:1788642353.547502:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddc5a3d000 for MGS 00000100:00100000:0.0:1788642353.547650:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547660:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547667:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547673:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547687:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547693:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547700:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547707:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547713:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547720:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547727:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547734:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547741:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547748:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547817:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547825:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547831:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547838:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547844:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547850:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547856:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547862:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547869:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547876:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547883:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547888:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547895:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547901:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547908:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547915:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547921:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547928:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547935:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547942:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547949:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547954:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547960:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547967:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547975:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547988:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.547994:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548002:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548009:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548016:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548023:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548029:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548036:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548043:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548049:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548056:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548062:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548069:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548075:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548080:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548086:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548092:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548245:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548253:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548259:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548266:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548273:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548279:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548286:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.548293:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788642353.549269:0:12993:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788642353.549276:0:12993:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788642353.550251:0:12993:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dddc6195480 - data ffff8dde017b9ca8/ffff8dddface9800 00000020:01000000:0.0:1788642353.550397:0:12993:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dddd0a86ae0 - data ffff8dddeb8020d8/ffff8ddde4e78c00 00000020:00000080:0.0:1788642353.554682:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666ce50 00000020:00000080:0.0:1788642353.554700:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddc2f82000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788642353.554740:0:12993:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dddc599b800 from MGS, refs=2 00000020:01000004:0.0:1788642353.554745:0:12993:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dddc599b800 2 00000020:01000004:0.0:1788642353.554749:0:12993:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dddc599b800 from MGS 00000020:00000080:0.0:1788642353.554865:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788642353.554876:0:12993:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788642353.554880:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddc2f81000/MGS 00000020:00000080:0.0:1788642353.554883:0:12993:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddc2f81000/MGS for MGS 00000020:01000000:0.0:1788642353.554895:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788642353.554969:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788642353.554975:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788642353.554981:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788642353.554990:0:12993:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dddfb5d5000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788642353.554996:0:12993:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8dddfa7c3380) has exports, disconnecting them 00000020:00080000:0.0:1788642353.555002:0:12993:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dddfb5d5000), last request at 1788642106 00000020:00000080:0.0:1788642353.555009:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666cf1b 00000020:00080000:0.0:1788642353.555029:0:12993:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dddfb5d5000): rc 0 00000020:00000080:0.0:1788642353.555035:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddfb5d5000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788642353.555658:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddc2f82000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788642353.555672:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfb5d5000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788642353.557264:0:12993:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788642353.557274:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788642353.557281:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788642353.557293:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788642353.557613:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788642353.557627:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788642353.557636:0:12993:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dddc599b800 1 00000020:00000080:1.0:1788642353.557646:0:12993:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666ce42 00000020:00000080:1.0:1788642353.557658:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddc2f85800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788642353.557865:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddfb5d4800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788642353.557875:0:37:0:(genops.c:885:class_export_put()) final put ffff8dddfb5d7000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788642353.557878:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfb5d7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788642353.557887:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1788642353.558231:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788642353.558258:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788642353.558266:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788642353.558272:0:12993:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8dddc6344d40) has no exports 00000020:00000080:2.0:1788642353.558407:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddc2f85800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788642353.605618:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788642353.605648:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788642353.605657:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddc599b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788642353.605664:0:12993:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddc599b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788642353.605683:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788642353.605973:0:12993:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dddc599d800 00000020:01000000:2.0:1788642353.606019:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788642353.606025:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788642353.606032:0:12993:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788642353.606039:0:12993:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dddc4e019c0) has no exports 00000100:00100000:0.0:1788642353.610022:0:9441:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8dddfb4c1c00:9441] 3 exiting: rc = 0 00000100:00100000:0.0:1788642353.610260:0:5863:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8dddc9ee8200:5863] 2 exiting: rc = 0 00000100:00100000:0.0:1788642353.610346:0:5862:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8dddc4e33400:5862] 1 exiting: rc = 0 00000100:00100000:2.0:1788642353.613706:0:5861:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8dddc4e32000:5861] 0 exiting: rc = 1 00000100:00100000:2.0:1788642353.613931:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.613940:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.613946:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.613957:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.613963:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.613970:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.613975:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.613981:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.613988:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.613994:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614000:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614007:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614013:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614019:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614026:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614032:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614038:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614045:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614052:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614058:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614065:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614071:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614079:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614230:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614238:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614257:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614265:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614271:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614277:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614284:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614290:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614297:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614305:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614311:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614318:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614324:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614330:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614336:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614342:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614348:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614354:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614361:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614368:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614376:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614383:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614390:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614397:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614404:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614409:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614416:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614423:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614430:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614499:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614506:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614513:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614518:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614525:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614531:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614613:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614621:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614627:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614634:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614641:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.614646:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.622200:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8dddc9ee9400:5865] 1 exiting: rc = 0 00000100:00100000:2.0:1788642353.622420:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8dddc9ee8000:5864] 0 exiting: rc = 1 00000100:00100000:0.0:1788642353.622611:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622624:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622632:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622640:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622647:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622655:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622664:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622671:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622678:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622684:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622692:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622698:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622706:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622711:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622716:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622739:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622744:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622749:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622754:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622760:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622830:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622840:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622853:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622860:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622866:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622873:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622880:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622886:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622892:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622899:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622906:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622914:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622920:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622926:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622932:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622939:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622945:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622952:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622960:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622966:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622972:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622979:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622985:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622992:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.622998:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623003:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623008:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623014:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623019:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623025:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623037:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623043:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623049:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623056:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623062:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623070:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623076:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623082:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623089:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623095:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623245:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623250:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623256:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.623265:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.624248:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8dddc5be5000:5866] 0 exiting: rc = 1 00000100:00100000:0.0:1788642353.624389:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8dddc5be5c00:5867] 1 exiting: rc = 0 00000100:00100000:1.0:1788642353.624502:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624510:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624527:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624536:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624612:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624621:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624630:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624638:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624644:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624651:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624663:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624670:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624677:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624683:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624691:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624714:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624721:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624745:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624752:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624760:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624829:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624838:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624846:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624854:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624860:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624868:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624876:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624897:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624905:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624912:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624921:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624928:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624935:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624942:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624949:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624956:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624963:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.624971:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625030:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625054:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625062:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625069:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625077:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625086:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625093:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625273:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625282:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625290:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625299:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625305:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625313:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625332:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625345:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625352:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625360:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625368:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625374:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625381:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625394:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625404:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625412:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625422:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625429:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.625444:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.644026:0:5869:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8dddc5be4e00:5869] 1 exiting: rc = 0 00000100:00100000:2.0:1788642353.644307:0:5868:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8dddc5be4800:5868] 0 exiting: rc = 1 00000100:00100000:0.0:1788642353.645402:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645411:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645418:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645424:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645430:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645436:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645442:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645448:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645454:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645459:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645466:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645472:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645479:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645485:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645491:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645497:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645503:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645509:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645515:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645542:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645547:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645554:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645561:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645567:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645572:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645578:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645584:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645589:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645594:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645600:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645606:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645611:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645616:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645622:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645732:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645740:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645745:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645751:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645757:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645762:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645768:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645774:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645779:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645785:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645790:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645796:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645801:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645807:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645812:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645817:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645823:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645828:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645833:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645838:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645850:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645856:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645862:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645868:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645874:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645881:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645886:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645892:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645898:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.645904:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.646643:0:5871:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8dddedcf7a00:5871] 1 exiting: rc = 0 00000100:00100000:2.0:1788642353.646731:0:5870:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8dddc59b5a00:5870] 0 exiting: rc = 1 00000100:00100000:3.0:1788642353.647971:0:11508:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0002: service thread [ffff8ddcc52e6c00:11508] 2 exiting: rc = 0 00000100:00100000:0.0:1788642353.649011:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649022:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649028:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649034:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649040:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649048:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649054:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649060:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649067:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649074:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649081:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649087:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649093:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649528:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649537:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649542:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649548:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649554:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649560:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649566:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649573:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649578:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649584:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649590:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649596:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649622:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649717:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649726:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649733:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649738:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649744:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649750:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649757:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649761:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649768:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649775:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649781:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649787:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649794:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649800:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649806:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649812:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649819:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649824:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649830:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649836:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649842:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649848:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649854:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649859:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649867:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649874:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649882:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649888:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649894:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649900:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649906:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649911:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649919:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649925:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649942:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649948:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649955:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.649961:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.656745:0:5873:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8dddc51ca800:5873] 1 exiting: rc = 0 00000100:00100000:3.0:1788642353.656881:0:5872:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8dddc51cb200:5872] 0 exiting: rc = 1 00000100:00100000:1.0:1788642353.657001:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657009:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657015:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657025:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657031:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657036:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657042:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657049:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657055:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657061:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657067:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657072:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657078:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657083:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657089:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657094:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657123:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657128:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657135:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657149:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657155:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657161:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657167:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657188:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657194:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657200:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657205:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657210:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657215:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657221:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657228:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657233:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657239:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657245:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657251:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657257:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657263:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657268:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657275:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657280:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657285:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657291:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657298:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657305:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657311:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657317:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657322:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657329:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657334:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657340:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657345:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657351:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657357:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657362:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657368:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657374:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657381:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657387:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657399:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657405:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657411:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657416:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657421:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642353.657427:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642353.658072:0:5874:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8dddc4ef1c00:5874] 0 exiting: rc = 1 00000100:00100000:1.0:1788642353.658857:0:5875:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8dddc4ef1000:5875] 1 exiting: rc = 0 00000100:00100000:3.0:1788642353.658935:0:5876:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8dddc4ef0200:5876] 2 exiting: rc = 0 00000100:00100000:0.0:1788642353.659406:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659416:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659422:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659428:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659435:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659442:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659449:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659455:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659461:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659468:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659475:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659483:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659509:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659516:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659522:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659528:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659534:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659539:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659545:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659552:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659559:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659567:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659573:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659579:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659585:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659592:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659600:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659607:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659615:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659621:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659729:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659747:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659752:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659759:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659766:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659772:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659795:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659803:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659808:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659813:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659819:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659825:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659831:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659836:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659842:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659849:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659855:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659861:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659867:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659872:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659879:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659885:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659895:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659902:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659909:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659916:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659923:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659928:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659934:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659940:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659946:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659953:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659960:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642353.659967:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788642353.666791:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788642353.666810:0:12993:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788642353.666829:0:12993:0:(genops.c:885:class_export_put()) final put ffff8dddd0f46000/MDS_uuid 00000020:00000080:0.0:1788642353.666835:0:12993:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddd0f46000/MDS_uuid for MDS 00000020:01000000:0.0:1788642353.666849:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788642353.667018:0:12993:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:2.0:1788642353.851566:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788642353.851812:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788642353.851820:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ddcc5338000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788642353.851832:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 436 00000100:00080000:2.0:1788642353.851840:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788642353.851849:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ddcc5338000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788642353.851884:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfa883b80 x1875527107436160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788642353.851911:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788642353.851915:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788642353.851917:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ddcc65ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788642353.851921:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 436 00000100:00080000:2.0:1788642353.851923:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788642353.851928:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ddcc65ca800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788642353.851939:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfa882680 x1875527107436288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788642353.851984:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107436032:0@lo:400:kworker.0 00000400:00000100:2.0:1788642353.852059:0:3317:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875527107436032 offset 0 length 224: 4 00000100:00100000:1.0:1788642353.852250:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1875527107436160:0@lo:38:kworker.0 00000400:00000100:1.0:1788642353.852279:0:3316:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875527107436160 offset 0 length 520: 4 00000100:00100000:1.0:1788642353.852295:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1875527107436288:0@lo:38:kworker.0 00000400:00000100:1.0:1788642353.852310:0:3316:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875527107436288 offset 0 length 520: 4 00010000:00010000:3.0:1788642354.109832:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642355.130801:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642356.155607:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788642357.135471:0:13150:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788642357.151411:0:13150:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788642357.151466:0:13150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642357.151482:0:13150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642357.151489:0:13150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642357.151497:0:13150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642357.151518:0:13150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788642357.151523:0:13150:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788642357.151544:0:13150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788642357.151555:0:13150:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dddfa883b80 x1875527107436160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788642368 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642357.151572:0:13150:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788642357.151577:0:13150:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788642357.151583:0:13150:0:(import.c:65:import_set_state_nolock()) ffff8ddcc5338000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788642357.151588:0:13150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788642357.151591:0:13150:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dddfa883b80 x1875527107436160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788642368 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642357.151597:0:13150:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788642357.151612:0:13150:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:1.0:1788642357.151729:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1875527107436160:0@lo:38:kworker.0 00010000:00010000:3.0:1788642357.152984:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642357.152994:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642357.153004:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9833600 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642357.153008:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642357.153019:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788642357.153027:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642357.153032:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788642357.153035:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788642357.153038:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788642357.153075:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642357.153082:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788642357.153193:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642357.153202:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddc9833600/0x4ae1ee156666d183 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d18a expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642357.153228:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642357.153230:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642357.153231:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642357.153302:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107436416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642357.153362:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642357.153578:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107436416 00000100:00100000:3.0:1788642357.153585:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107436416 00000100:00100000:3.0:1788642357.153635:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788642357.153643:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3318:x1875527107436416:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788642357.153649:0:5847:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788642357 with bad export cookie 5395855604246302316 00010000:00010000:2.0:1788642357.155085:0:13150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642357.155130:0:13150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642357.155139:0:13150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642357.155145:0:13150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642357.155161:0:13150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788642357.155168:0:13150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642357.155175:0:13150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642357.155182:0:13150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642357.155190:0:13150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642357.155210:0:13150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788642357.155215:0:13150:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788642357.155244:0:13150:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788642357.155248:0:13150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788642357.155254:0:13150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788642357.155430:0:7657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788642357.155438:0:7657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642357.155445:0:7657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50a00 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:1.0:1788642357.155449:0:7657:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642357.155459:0:7657:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788642357.155467:0:7657:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642357.155473:0:7657:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788642357.155476:0:7657:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788642357.155485:0:7657:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788642357.155525:0:7657:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642357.155532:0:7657:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788642357.155559:0:7657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642357.155568:0:7657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50a00/0x4ae1ee156666d191 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d198 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642357.155583:0:7657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642357.155586:0:7657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642357.155592:0:7657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb50000 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:1.0:1788642357.155596:0:7657:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642357.155602:0:7657:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788642357.155608:0:7657:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642357.155614:0:7657:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788642357.155616:0:7657:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788642357.155618:0:7657:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788642357.155631:0:7657:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642357.155637:0:7657:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788642357.155651:0:7657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642357.155657:0:7657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddcfb50000/0x4ae1ee156666d3c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4ae1ee156666d3cf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642357.155666:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642357.155668:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642357.155670:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642357.155703:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107436672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788642357.155783:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642357.155838:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788642357.155845:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107436544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788642357.155887:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642357.155916:0:5846:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788642357.155926:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788642357.156459:0:5845:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788642357.156471:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107436672 00000100:00100000:0.0:1788642357.156479:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107436672 00000100:00100000:0.0:1788642357.156512:0:5845:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788642357.156517:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107436544 00000100:00100000:0.0:1788642357.156519:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107436544 00000020:00000080:2.0:1788642357.160421:0:13150:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788642357.160437:0:13150:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8dddc63419c0) has no exports 00000020:00080000:2.0:1788642357.160487:0:13150:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8dddc63419c0) has no exports 00000100:00100000:0.0:1788642357.164410:0:13151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788642357.164423:0:13151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3320:x1875527107436672:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788642357.164431:0:13151:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788642357 with bad export cookie 5395855604246302316 00000100:00100000:0.0:1788642357.164531:0:13151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3320:x1875527107436672:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (8747us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788642357.164539:0:13151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788642357.164559:0:13151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788642357.164563:0:13151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc7e7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3320:x1875527107436544:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788642357.164567:0:13151:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788642357 with bad export cookie 5395855604246302316 00000100:00100000:0.0:1788642357.164595:0:13151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc7e7c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3320:x1875527107436544:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (8708us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788642357.164601:0:13151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788642357.164783:0:3320:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.149@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788642357.164790:0:3320:0:(import.c:65:import_set_state_nolock()) ffff8dddd0f40000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788642357.164793:0:3320:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.149@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:2.0:1788642357.167685:0:13150:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ddcc6f79960 - data ffff8dde017a66c0/ffff8dddeff87400 00000020:01000000:2.0:1788642357.168044:0:13150:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dddc4d87060 - data ffff8dddeb80f870/ffff8ddcc504f800 00000100:00100000:3.0:1788642357.171910:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3318:x1875527107436416:12345-0@lo:103:ldlm_bl.0 Request processed in 18251us (18532us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788642357.171933:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788642357.172078:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.149@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1788642357.198470:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642357.202219:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788642357.205002:0:3320:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.149@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788642357.205009:0:3320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788642357.205021:0:3320:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dddfa882d80 x1875527107436032/t0(0) o400->MGC192.168.202.149@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788642369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642357.205052:0:3320:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dddfb40c380 x1875527107436416/t0(0) o103->MGC192.168.202.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788642373 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642357.205062:0:3320:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dddfad1ea00 x1875527107436672/t0(0) o103->MGC192.168.202.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788642373 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788642357.205071:0:3320:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dddfad1d500 x1875527107436544/t0(0) o103->MGC192.168.202.149@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788642373 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788642357.205179:0:3318:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8dddd0f40000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788642357.205364:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae59d524-c809-4baa-a38f-29c60bd72e4e:3318:1875527107436416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788642357.206501:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae59d524-c809-4baa-a38f-29c60bd72e4e:3317:1875527107436032:0@lo:400:kworker.0 10000000:01000000:1.0:1788642357.209454:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788642357.209462:0:3320:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788642357.209464:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788642357.209469:0:3320:0:(import.c:65:import_set_state_nolock()) ffff8dddd0f40000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788642357.209478:0:3320:0:(import.c:545:import_select_connection()) MGC192.168.202.149@tcp: connect to NID 0@lo last attempt 192 00000100:00080000:1.0:1788642357.209488:0:3320:0:(import.c:665:import_select_connection()) MGC192.168.202.149@tcp: import ffff8dddd0f40000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:0.0:1788642357.209707:0:3320:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ddcc6338a80 x1875527107436800/t0(0) o250->MGC192.168.202.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788642357.209762:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107436672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642357.209791:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae59d524-c809-4baa-a38f-29c60bd72e4e:3320:1875527107436544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788642357.209974:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae59d524-c809-4baa-a38f-29c60bd72e4e:3316:1875527107436800:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1788642357.210039:0:3316:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875527107436800 offset 0 length 520: 4 00100000:10000000:2.0:1788642357.219913:0:13150:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788642357.312652:0:13150:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666cfa0 00000020:00000080:3.0:1788642357.312664:0:13150:0:(genops.c:885:class_export_put()) final put ffff8ddcc509f800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788642357.312688:0:13150:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dddef9be800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788642357.312692:0:13150:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dddef9be800 2 00000020:01000004:3.0:1788642357.312704:0:13150:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dddef9be800 from lustre-OST0000 00000020:00000080:3.0:1788642357.312728:0:13150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788642357.312739:0:13150:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788642357.312742:0:13150:0:(genops.c:885:class_export_put()) final put ffff8ddddbdf9800/lustre-OST0000_UUID 00000020:00000080:3.0:1788642357.312745:0:13150:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddddbdf9800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788642357.312752:0:13150:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788642357.312811:0:13150:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788642357.312815:0:13150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788642357.312819:0:13150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788642357.312838:0:13150:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788642357.312846:0:13150:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ddcc4910000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788642357.312852:0:13150:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8dddc6340000) has exports, disconnecting them 00000020:00000080:1.0:1788642357.313388:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc509f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:3.0:1788642357.313496:0:13150:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ddcc4910000), last request at 1788642123 00000020:00000080:3.0:1788642357.313502:0:13150:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666cfca 00000020:00080000:3.0:1788642357.313517:0:13150:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ddcc4910000): rc 0 00000020:00000080:3.0:1788642357.313525:0:13150:0:(genops.c:885:class_export_put()) final put ffff8ddcc4910000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788642357.314927:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc4910000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788642357.315184:0:13150:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788642357.315188:0:13150:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788642357.315193:0:13150:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788642357.315199:0:13150:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788642357.315374:0:13150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788642357.315385:0:13150:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788642357.315392:0:13150:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dddef9be800 1 00000020:00000080:2.0:1788642357.315410:0:13150:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666cf4c 00000020:00000080:2.0:1788642357.315419:0:13150:0:(genops.c:885:class_export_put()) final put ffff8dddfd7cb800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788642357.315424:0:13150:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788642357.315429:0:13150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788642357.315432:0:13150:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788642357.315436:0:13150:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8dddfd7d99c0) has no exports 00000020:00000080:1.0:1788642357.317034:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ddcc5338000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788642357.317049:0:38:0:(genops.c:885:class_export_put()) final put ffff8ddcc509a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788642357.317052:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc509a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788642357.317059:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788642357.317139:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfd7cb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788642357.350291:0:13150:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788642357.350320:0:13150:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788642357.350326:0:13150:0:(genops.c:885:class_export_put()) final put ffff8dddef9ba800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788642357.350339:0:13150:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddef9ba800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788642357.350350:0:13150:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788642357.350502:0:13150:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dddef9bf800 00000020:02000400:1.0:1788642357.350553:0:13150:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788642358.204400:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788642358.973343:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) ae59d524-c809-4baa-a38f-29c60bd72e4e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788642358.973353:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) ae59d524-c809-4baa-a38f-29c60bd72e4e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788642358.973356:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788642358.973359:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788642359.226389:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642360.252367:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788642360.427371:0:13302:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788642360.438352:0:13302:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788642360.438445:0:13302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642360.438462:0:13302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642360.438485:0:13302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642360.438492:0:13302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642360.438519:0:13302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788642360.438525:0:13302:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788642360.438547:0:13302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788642360.438561:0:13302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dddfa882680 x1875527107436288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788642368 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642360.438583:0:13302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788642360.438590:0:13302:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788642360.438597:0:13302:0:(import.c:65:import_set_state_nolock()) ffff8ddcc65ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788642360.438602:0:13302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788642360.438606:0:13302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dddfa882680 x1875527107436288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788642368 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642360.438614:0:13302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788642360.438617:0:13302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00010000:00010000:1.0:1788642360.438632:0:7657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642360.438640:0:7657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642360.438647:0:7657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddc9832000 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:1.0:1788642360.438651:0:7657:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642360.438667:0:7657:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788642360.438674:0:7657:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642360.438679:0:7657:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788642360.438681:0:7657:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788642360.438683:0:7657:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1788642360.438685:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1875527107436288:0@lo:38:kworker.0 00010000:00010000:1.0:1788642360.438696:0:7657:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dddd0f40000 00010000:00010000:1.0:1788642360.438701:0:7657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642360.438707:0:7657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddc9832000/0x4ae1ee156666d167 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4ae1ee156666d16e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642360.438719:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642360.438720:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642360.438722:0:7657:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642360.443841:0:13302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642360.443995:0:13302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642360.444004:0:13302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642360.444012:0:13302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642360.444054:0:13302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788642360.444063:0:13302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642360.444069:0:13302:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642360.444075:0:13302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642360.444094:0:13302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642360.444132:0:13302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788642360.444137:0:13302:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788642360.444164:0:13302:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788642360.444168:0:13302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788642360.444202:0:13302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788642360.444209:0:13302:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788642360.444214:0:13302:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dddeff419c0) has no exports 00010000:00010000:3.0:1788642360.444217:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788642360.444224:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642360.444231:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121000 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642360.444235:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788642360.444239:0:13302:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dddeff419c0) has no exports 00010000:00010000:3.0:1788642360.444244:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788642360.444252:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642360.444257:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788642360.444259:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788642360.444262:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788642360.444275:0:5849:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dddd0f40000 00010000:00010000:3.0:1788642360.444278:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642360.444285:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666d175 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4ae1ee156666d17c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642360.444308:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642360.444311:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642360.444316:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddcfb51800 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:3.0:1788642360.444319:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642360.444325:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788642360.444332:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642360.444337:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788642360.444339:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788642360.444341:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788642360.444347:0:5849:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dddd0f40000 00010000:00010000:3.0:1788642360.444350:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642360.444355:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddcfb51800/0x4ae1ee156666d3ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4ae1ee156666d3c1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642360.444372:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642360.444374:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642360.444377:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642360.444461:0:5848:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788642360.450465:0:13302:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ddcc6f79660 - data ffff8dde017a6a20/ffff8ddcc4a44c00 00000020:01000000:1.0:1788642360.451209:0:13302:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dddfd80eae0 - data ffff8dde0171a870/ffff8ddcc4ba7800 00100000:10000000:1.0:1788642360.467799:0:13302:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788642360.494550:0:13302:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d06b 00000020:00000080:0.0:1788642360.494565:0:13302:0:(genops.c:885:class_export_put()) final put ffff8ddcc4915000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788642360.494587:0:13302:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ddcc509b000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788642360.494590:0:13302:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ddcc509b000 2 00000020:01000004:0.0:1788642360.494594:0:13302:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ddcc509b000 from lustre-OST0001 00000020:00000080:0.0:1788642360.494618:0:13302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788642360.494629:0:13302:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788642360.494632:0:13302:0:(genops.c:885:class_export_put()) final put ffff8dddff6b5000/lustre-OST0001_UUID 00000020:00000080:0.0:1788642360.494634:0:13302:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddff6b5000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788642360.494641:0:13302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788642360.494778:0:13302:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ae59d524-c809-4baa-a38f-29c60bd72e4e->MGS 00010000:00010000:0.0:1788642360.494794:0:13302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddd6120c00/0x4ae1ee156666cf7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666cf84 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642360.494806:0:13302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddd6120c00/0x4ae1ee156666cf7d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666cf84 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642360.494825:0:13302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788642360.494828:0:13302:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788642360.494831:0:13302:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788642360.494845:0:13302:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dddd0f40000 00010000:00010000:0.0:1788642360.494849:0:13302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddd6120c00/0x4ae1ee156666cf7d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4ae1ee156666cf84 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788642360.495036:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc4915000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:0.0:1788642360.495210:0:13302:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddc9832200/0x4ae1ee156666d1bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4ae1ee156666d1c2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642360.495217:0:13302:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddc9832200/0x4ae1ee156666d1bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4ae1ee156666d1c2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642360.495222:0:13302:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788642360.495225:0:13302:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788642360.495227:0:13302:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788642360.495244:0:13302:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dddd0f40000 00010000:00010000:0.0:1788642360.495247:0:13302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddc9832200/0x4ae1ee156666d1bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4ae1ee156666d1c2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788642360.495263:0:13302:0:(import.c:65:import_set_state_nolock()) ffff8dddd0f40000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788642360.495267:0:13302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788642360.495269:0:13302:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788642360.495270:0:13302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788642360.495275:0:13302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788642360.495286:0:13302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ddcc6338a80 x1875527107436800/t0(0) o250->MGC192.168.202.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788642367 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788642360.495377:0:13302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788642360.495381:0:13302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1788642360.495696:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae59d524-c809-4baa-a38f-29c60bd72e4e:3316:1875527107436800:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:0.0:1788642360.495774:0:13302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788642360.495782:0:13302:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666ce5e 00000020:00000080:0.0:1788642360.495788:0:13302:0:(genops.c:885:class_export_put()) final put ffff8dddd0f43800/ae59d524-c809-4baa-a38f-29c60bd72e4e 00000020:01000000:0.0:1788642360.495806:0:13302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.149@tcp (flags='') 00000020:00000080:3.0:1788642360.495956:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddd0f43800/ae59d524-c809-4baa-a38f-29c60bd72e4e for MGC192.168.202.149@tcp 00000020:00000080:0.0:1788642360.496043:0:13302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788642360.496050:0:13302:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.149@tcp: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788642360.496054:0:13302:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8dddc4e04d40) has no exports 10000000:01000000:2.0:1788642360.496133:0:5858:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788642360.496257:0:13302:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.149@tcp: client import never connected 00000100:00080000:0.0:1788642360.496265:0:13302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788642360.496267:0:13302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788642360.496269:0:13302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788642360.496271:0:13302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788642360.496311:0:13302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788642360.496316:0:13302:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.149@tcp (uuid ae59d524-c809-4baa-a38f-29c60bd72e4e) 00000020:01000000:0.0:1788642360.496321:0:13302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788642360.496324:0:13302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788642360.496327:0:13302:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788642360.496332:0:13302:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8dddeff02000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788642360.496337:0:13302:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8dddfd7d8000) has exports, disconnecting them 00000020:00080000:0.0:1788642360.496341:0:13302:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8dddeff02000), last request at 1788642142 00000020:00000080:0.0:1788642360.496345:0:13302:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d095 00000020:00080000:0.0:1788642360.496356:0:13302:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dddeff02000): rc 0 00000020:00000080:0.0:1788642360.496359:0:13302:0:(genops.c:885:class_export_put()) final put ffff8dddeff02000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788642360.496446:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dddd0f40000 for MGC192.168.202.149@tcp 00000020:00000080:3.0:1788642360.496452:0:8:0:(genops.c:885:class_export_put()) final put ffff8dddd0f42000/ae59d524-c809-4baa-a38f-29c60bd72e4e 00000020:00000080:3.0:1788642360.496454:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddd0f42000/ae59d524-c809-4baa-a38f-29c60bd72e4e for MGC192.168.202.149@tcp 00000020:01000000:3.0:1788642360.496458:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.149@tcp (ae59d524-c809-4baa-a38f-29c60bd72e4e) 00000020:00000080:3.0:1788642360.496697:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddeff02000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788642360.509665:0:13302:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788642360.509674:0:13302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788642360.509679:0:13302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788642360.509687:0:13302:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788642360.509755:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ddcc65ca800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788642360.509792:0:7657:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788642360.509939:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788642360.510134:0:5848:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788642360.510208:0:5844:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8dddc59b5200:5844] 1 exiting: rc = 0 00000100:00100000:0.0:1788642360.510213:0:5843:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8dddc5bc8e00:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1788642360.510282:0:7656:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8dddfb5af400:7656] 2 exiting: rc = 0 00000100:00100000:0.0:1788642360.510326:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788642360.510567:0:5845:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8dddc59b5800:5845] 0 exiting: rc = 1 00000100:00100000:0.0:1788642360.510568:0:13151:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8dddc4ef0a00:13151] 3 exiting: rc = 0 00000100:00100000:3.0:1788642360.510633:0:5846:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8dddc59b4c00:5846] 1 exiting: rc = 0 00000100:00100000:2.0:1788642360.510754:0:5847:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8dddc59b5e00:5847] 2 exiting: rc = 0 00000100:00100000:0.0:1788642360.510795:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510802:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510809:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510815:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510820:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510826:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510832:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510838:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510844:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510859:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510865:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510871:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510877:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510883:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510889:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510895:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510902:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510909:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510914:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510918:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510923:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510928:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510934:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510939:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510944:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510950:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510955:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510960:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510965:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510969:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510975:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.510980:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511055:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511063:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511068:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511073:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511078:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511084:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511094:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511116:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511121:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511127:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511133:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511138:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511151:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511156:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511162:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511167:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511172:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511177:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511194:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511200:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511205:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511210:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511214:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511219:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511224:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511229:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511233:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511238:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511247:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511253:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511258:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.511263:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788642360.512603:0:13302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788642360.512614:0:13302:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788642360.512620:0:13302:0:(genops.c:885:class_export_put()) final put ffff8ddcc65c8000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788642360.512624:0:13302:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc65c8000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788642360.512629:0:13302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788642360.512676:0:13302:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ddcc509b000 1 00000020:00000080:0.0:1788642360.512683:0:13302:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4ae1ee156666d03a 00000020:00000080:0.0:1788642360.512690:0:13302:0:(genops.c:885:class_export_put()) final put ffff8ddcc509e000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788642360.512706:0:13302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788642360.512710:0:13302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788642360.512715:0:13302:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788642360.512719:0:13302:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dddc6343380) has no exports 00000020:00000080:3.0:1788642360.513295:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc509e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788642360.525417:0:13302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788642360.525435:0:13302:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788642360.525455:0:13302:0:(genops.c:885:class_export_put()) final put ffff8ddcc5098800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788642360.525460:0:13302:0:(genops.c:844:class_export_destroy()) destroying export ffff8ddcc5098800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788642360.525467:0:13302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788642360.525653:0:13302:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ddcc509c000 00000020:01000000:0.0:1788642360.525690:0:13302:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788642360.525694:0:13302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788642360.525698:0:13302:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788642360.525703:0:13302:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8dddfa7c4d40) has no exports 00000020:00000080:0.0:1788642360.525726:0:13302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788642360.525733:0:13302:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788642360.525736:0:13302:0:(genops.c:885:class_export_put()) final put ffff8dddfd7ce800/OSS_uuid 00000020:00000080:0.0:1788642360.525738:0:13302:0:(genops.c:844:class_export_destroy()) destroying export ffff8dddfd7ce800/OSS_uuid for OSS 00000020:01000000:0.0:1788642360.525742:0:13302:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788642360.525859:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8dddfd815a00:6711] 1 exiting: rc = 0 00000100:00100000:3.0:1788642360.526045:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8dddfab7c000:6712] 2 exiting: rc = 0 00000100:00100000:3.0:1788642360.526095:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8dddfd906600:6709] 0 exiting: rc = 1 00000100:00080000:1.0:1788642360.526995:0:5857:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788642360.528348:0:9442:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8dddfacece00:9442] 3 exiting: rc = 0 00000100:00100000:0.0:1788642360.528475:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528483:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528490:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528496:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528502:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528507:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528512:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528518:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528523:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528528:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528533:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528538:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528542:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528547:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528552:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528557:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528563:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528569:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528574:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528579:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528599:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528604:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528609:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528615:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528620:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528625:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528629:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528635:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528640:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528645:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528650:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528654:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528660:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528666:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528671:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528676:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528681:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528686:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528691:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528696:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528701:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528706:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528711:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528715:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528720:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528727:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528732:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528737:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528743:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528748:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528752:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528757:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528762:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528767:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528772:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528785:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528790:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528798:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528804:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528809:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528813:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528819:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528823:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.528828:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.529761:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8dddfab7c800:6714] 1 exiting: rc = 0 00000100:00100000:3.0:1788642360.529894:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8dddfd906c00:6713] 0 exiting: rc = 1 00000100:00100000:0.0:1788642360.530017:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530026:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530032:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530037:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530043:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530048:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530054:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530059:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530065:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530070:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530076:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530081:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530087:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530093:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530167:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530174:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530180:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530195:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530201:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530207:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530212:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530218:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530223:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530228:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530234:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530239:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530257:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530262:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530268:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530273:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530278:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530284:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530290:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530296:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530301:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530307:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530312:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530318:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530322:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530327:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530333:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530338:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530344:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530349:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530354:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530359:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530364:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530370:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530376:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530382:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530387:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530393:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530399:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530404:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530410:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530416:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530421:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530426:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530431:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530437:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530442:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530455:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530460:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.530466:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788642360.534118:0:6716:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8dddc651ac00:6716] 1 exiting: rc = 0 00000100:00100000:0.0:1788642360.534982:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8dddc651b200:6715] 0 exiting: rc = 1 00000100:00100000:0.0:1788642360.535527:0:6717:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8dddfab6e200:6717] 2 exiting: rc = 0 00000100:00100000:1.0:1788642360.535641:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535649:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535656:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535676:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535682:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535688:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535693:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535698:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535703:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535709:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535715:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535720:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535726:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535731:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535736:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535742:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535747:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535753:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535758:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535774:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535781:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535786:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535792:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535797:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535805:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535811:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535830:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535836:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535842:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535848:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535853:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535860:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.535992:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536001:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536007:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536013:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536019:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536024:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536037:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536042:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536046:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536051:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536056:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536078:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536086:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536091:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536251:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536259:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536265:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536271:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536276:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536281:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536287:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536291:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536297:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536302:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536308:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536313:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536319:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536323:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536328:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536333:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536338:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.536344:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788642360.542844:0:6718:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8dddfab6e000:6718] 0 exiting: rc = 1 00000100:00100000:0.0:1788642360.543199:0:6719:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8dddfab6f400:6719] 1 exiting: rc = 0 00000100:00100000:1.0:1788642360.543359:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543367:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543374:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543380:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543385:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543391:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543396:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543403:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543408:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543431:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543436:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543442:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543448:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543462:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543470:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543475:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543481:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543487:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543492:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543498:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543504:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543509:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543514:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543519:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543524:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543529:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543534:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543538:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543542:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543548:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543554:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543559:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543563:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543570:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543575:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543581:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543585:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543590:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543596:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543602:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543607:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543612:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543617:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543623:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543638:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543644:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543651:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543656:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543661:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543666:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543672:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543677:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543682:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543686:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543691:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543696:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543701:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543707:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543713:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543718:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543723:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543728:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543735:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.543740:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.544667:0:6722:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8dddff6a8600:6722] 1 exiting: rc = 0 00000100:00100000:0.0:1788642360.544951:0:6721:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8dddfab58400:6721] 0 exiting: rc = 1 00000100:00100000:1.0:1788642360.545224:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545242:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545252:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545260:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545267:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545274:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545280:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545288:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545294:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545301:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545309:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545316:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545322:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545343:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545367:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545374:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545381:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545388:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545394:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545399:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545407:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545413:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545419:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545426:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545433:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545454:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545461:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545467:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545477:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545483:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545490:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545496:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545502:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545508:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545515:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545521:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545528:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545550:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545559:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545564:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545572:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545580:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545588:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545595:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545601:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545609:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545617:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545625:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545632:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545662:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545670:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545678:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545685:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545691:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545697:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545703:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545712:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545718:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545725:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545732:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545740:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545762:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545770:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788642360.545777:0:13302:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788642360.562527:0:13302:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788642380.225479:0:13917:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788642391.049943:0:14377:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788642391.049950:0:14377:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788642391.050064:0:14377:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dddf7f24800 00000020:01000004:3.0:1788642391.050081:0:14377:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788642391.050088:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788642391.050132:0:14377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dddfd7db380) 00000020:00000080:3.0:1788642391.050146:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788642391.120819:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788642391.130699:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788642391.131081:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 543: rc = 0 00100000:10000000:1.0:1788642391.131213:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 543: rc = 0 00100000:10000000:1.0:1788642391.131305:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 543: rc = 0 00100000:10000000:1.0:1788642391.131401:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 543: rc = 0 00100000:10000000:1.0:1788642391.131583:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788642391.131651:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 543: rc = 0 00100000:10000000:1.0:1788642391.131746:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 543: rc = 0 00100000:10000000:1.0:1788642391.132013:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 545: rc = 0 00100000:10000000:1.0:1788642391.137978:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 456: rc = 0 00100000:10000000:1.0:1788642391.138082:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 456: rc = 0 00100000:10000000:1.0:1788642391.140306:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 642: rc = 0 00100000:10000000:1.0:1788642391.141872:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 642: rc = 0 00100000:10000000:1.0:1788642391.142175:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 642: rc = 0 00100000:10000000:2.0:1788642391.150975:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:2.0:1788642391.151404:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 642: rc = 0 00100000:10000000:2.0:1788642391.151920:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 642: rc = 0 00100000:10000000:2.0:1788642391.153406:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 642: rc = 0 00100000:10000000:2.0:1788642391.154095:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 642: rc = 0 00100000:10000000:2.0:1788642391.154883:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:2.0:1788642391.155169:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 642: rc = 0 00100000:10000000:2.0:1788642391.158766:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:2.0:1788642391.160381:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 642: rc = 0 00100000:10000000:2.0:1788642391.162826:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 775: rc = 0 00100000:10000000:2.0:1788642391.164426:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 775: rc = 0 00100000:10000000:2.0:1788642391.165058:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 775: rc = 0 00100000:10000000:2.0:1788642391.166997:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 775: rc = 0 00100000:10000000:2.0:1788642391.168890:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 775: rc = 0 00100000:10000000:2.0:1788642391.170969:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 775: rc = 0 00100000:10000000:2.0:1788642391.171304:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 775: rc = 0 00100000:10000000:2.0:1788642391.171548:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 775: rc = 0 00100000:10000000:2.0:1788642391.172919:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 775: rc = 0 00100000:10000000:2.0:1788642391.174973:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 775: rc = 0 00100000:10000000:2.0:1788642391.175813:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 775: rc = 0 00100000:10000000:2.0:1788642391.176077:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 775: rc = 0 00100000:10000000:2.0:1788642391.177907:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 775: rc = 0 00100000:10000000:2.0:1788642391.178218:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 775: rc = 0 00100000:10000000:2.0:1788642391.178511:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 775: rc = 0 00100000:10000000:2.0:1788642391.178774:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 775: rc = 0 00100000:10000000:2.0:1788642391.179039:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 775: rc = 0 00100000:10000000:2.0:1788642391.179351:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 775: rc = 0 00100000:10000000:2.0:1788642391.179597:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 775: rc = 0 00100000:10000000:2.0:1788642391.179864:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 775: rc = 0 00100000:10000000:2.0:1788642391.180143:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 775: rc = 0 00100000:10000000:2.0:1788642391.180408:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 775: rc = 0 00100000:10000000:2.0:1788642391.180644:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 775: rc = 0 00100000:10000000:3.0:1788642391.189003:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 775: rc = 0 00100000:10000000:3.0:1788642391.190833:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 775: rc = 0 00100000:10000000:3.0:1788642391.191159:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 775: rc = 0 00100000:10000000:3.0:1788642391.193927:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 775: rc = 0 00100000:10000000:3.0:1788642391.198068:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 775: rc = 0 00100000:10000000:3.0:1788642391.198924:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 775: rc = 0 00100000:10000000:3.0:1788642391.202775:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 775: rc = 0 00100000:10000000:3.0:1788642391.203090:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 775: rc = 0 00100000:10000000:3.0:1788642391.205873:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 775: rc = 0 00100000:10000000:3.0:1788642391.207950:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 460: rc = 0 00100000:10000000:3.0:1788642391.210234:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788642391.213383:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 635: rc = 0 00100000:10000000:3.0:1788642391.214045:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788642391.214145:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 635: rc = 0 00100000:10000000:3.0:1788642391.216026:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788642391.216152:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 635: rc = 0 00100000:10000000:3.0:1788642391.224291:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788642391.224394:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 457: rc = 0 00100000:10000000:3.0:1788642391.224644:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788642391.224729:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 457: rc = 0 00100000:10000000:3.0:1788642391.224946:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788642391.225016:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 457: rc = 0 00000020:00000080:3.0:1788642391.225315:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788642391.225323:0:14377:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788642391.225334:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666e15f 00000020:01000004:3.0:1788642391.225341:0:14377:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788642391.225346:0:14377:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788642391.225352:0:14377:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dddf7f24800 from MGS 00000020:01000004:3.0:1788642391.225356:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788642391.225366:0:14377:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dddfd7d8000) 00000020:00000080:3.0:1788642391.225376:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788642391.225427:0:14377:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dddf7f24800 from MGS, refs=2 00080000:01000000:3.0:1788642391.225431:0:14377:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788642391.225435:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666e16d 00000100:00100000:3.0:1788642391.225526:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788642391.225664:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788642391.225670:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788642391.235827:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788642391.235858:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788642391.272536:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788642391.277292:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788642391.277306:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788642391.279535:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788642391.279547:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788642391.280889:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788642391.280898:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788642391.281557:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642391.281560:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642391.281562:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642391.281879:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642391.281882:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642391.281884:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642391.282344:0:14377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788642391.287790:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788642391.305701:0:14377:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788642391.305722:0:14377:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788642391.305725:0:14377:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788642391.309607:0:14386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788642391.309830:0:14377:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788642391.309964:0:14377:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788642391.310712:0:14377:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788642391.311024:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788642391.311209:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788642391.311215:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788642391.318833:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788642391.318845:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788642391.331194:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788642391.331209:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788642391.332544:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788642391.332566:0:14377:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.149@tcp' 00000020:01000004:0.0:1788642391.332567:0:14377:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788642391.332600:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.149@tcp (typ=mgc) 00000020:00000080:0.0:1788642391.332613:0:14377:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.149@tcp (ffff8dddc4e019c0) 00000020:00000080:0.0:1788642391.332631:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788642391.332703:0:14377:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dddfb5d4800@MGC192.168.202.149@tcp: add connection 192.168.202.149@tcp at head 00010000:00010000:0.0:1788642391.332860:0:14377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.149@tcp-0 is initialized 00000040:01000000:0.0:1788642391.332884:0:14377:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788642391.333202:0:14391:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788642391.347005:0:14393:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788642391.347454:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.149@tcp (uuid 228e481e-56eb-4de3-bc1a-1dbb71f0c898) 00000020:00000080:1.0:1788642391.348375:0:14377:0:(genops.c:1385:class_connect()) connect: client 228e481e-56eb-4de3-bc1a-1dbb71f0c898, cookie 0x4ae1ee156666e17b 00000100:00080000:1.0:1788642391.348391:0:14377:0:(import.c:545:import_select_connection()) MGC192.168.202.149@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788642391.348792:0:14377:0:(import.c:665:import_select_connection()) MGC192.168.202.149@tcp: import ffff8dddfb5d4800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:1.0:1788642391.348834:0:14377:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfad1e300 x1875527107436928/t0(0) o250->MGC192.168.202.149@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788642391.348874:0:14377:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 228e481e-56eb-4de3-bc1a-1dbb71f0c898->MGS 00000020:01000004:1.0:1788642391.348904:0:14377:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788642391.348912:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788642391.348927:0:14377:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8dddeff43380) 00000020:00000080:1.0:1788642391.348941:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788642391.349388:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3316:1875527107436928:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788642391.349456:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642391.360654:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107436928 00000100:00100000:3.0:1788642391.360671:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107436928 00000100:00100000:3.0:1788642391.360717:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788642391.360726:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd7ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3316:x1875527107436928:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788642391.360763:0:14387:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 228e481e-56eb-4de3-bc1a-1dbb71f0c898@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:3.0:1788642391.360791:0:14387:0:(genops.c:1385:class_connect()) connect: client 228e481e-56eb-4de3-bc1a-1dbb71f0c898, cookie 0x4ae1ee156666e189 00000100:00080000:3.0:1788642391.360939:0:14387:0:(import.c:65:import_set_state_nolock()) ffff8ddcc65ca800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788642391.361023:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd7ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+5:3316:x1875527107436928:12345-0@lo:250:mount.lustre.0 Request processed in 296us (11566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642391.361031:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788642391.361216:0:3316:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.149@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788642391.361226:0:3316:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.149@tcp: connect to target with instance 0 00000100:00080000:2.0:1788642391.361234:0:3316:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.149@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788642391.361239:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788642391.361242:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddfb5d4800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788642391.361244:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788642391.361557:0:3316:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788642391.361565:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3316:1875527107436928:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788642391.376814:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788642391.377041:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788642391.377049:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788642391.387276:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788642391.387295:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788642391.397705:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788642391.397723:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788642391.404846:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788642391.405044:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788642391.405050:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788642391.406005:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788642391.406013:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788642391.495498:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788642391.495990:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788642391.495997:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788642391.498218:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788642391.498232:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788642391.498987:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788642391.499185:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788642391.499190:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788642391.500782:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788642391.500793:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788642391.501699:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788642391.501864:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788642391.501875:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788642391.504710:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788642391.504726:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788642391.521873:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788642391.522066:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788642391.522073:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788642391.527216:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788642391.527230:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788642391.583030:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788642391.585701:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788642391.585715:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788642391.603413:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788642391.603438:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788642391.618981:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788642391.618997:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788642391.620460:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788642391.620492:0:14377:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788642391.620500:0:14377:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.149@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788642391.620648:0:14377:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788642391.620691:0:14377:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.149@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788642391.620698:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788642391.620700:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788642391.620701:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642391.620710:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642391.620712:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642391.620713:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642391.620714:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788642391.620716:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788642391.620718:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642391.620719:0:14377:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788642391.620723:0:14377:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788642391.620727:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788642391.620728:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788642391.620730:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642391.620730:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642391.620731:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642391.620732:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642391.620733:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788642391.620734:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788642391.620735:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642391.620736:0:14377:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788642391.620769:0:14377:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788642391.620787:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437056:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788642391.620855:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642391.620976:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788642391.624419:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107437056 00000100:00100000:0.0:1788642391.624438:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107437056 00000100:00100000:0.0:1788642391.624511:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788642391.624525:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd7ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+5:14377:x1875527107437056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788642391.625185:0:14390:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788642391.625188:0:14390:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788642391.625192:0:14390:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788642391.625955:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788642391.627293:0:14390:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788642391.633338:0:14412:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788642391.633346:0:14412:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788642391.633348:0:14412:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788642391.633384:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788642391.633930:0:14390:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788642391.633945:0:14390:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788642391.670335:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd7ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+5:14377:x1875527107437056:12345-0@lo:253:mount.lustre.0 Request processed in 45786us (49450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642391.670355:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788642391.670804:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437056:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788642391.670821:0:14377:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788642391.670824:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788642391.670826:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788642391.670827:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642391.670828:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642391.670829:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642391.670830:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642391.670831:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788642391.670833:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788642391.670835:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642391.670836:0:14377:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788642391.670854:0:14377:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dddf7f24800 from lustre-MDT0000 10000000:01000000:3.0:1788642391.670883:0:14377:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788642391.670886:0:14377:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788642391.670897:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8dddc4e019c0 10000000:01000000:3.0:1788642391.670901:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788642391.670908:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dddc4e019c0 from 1 10000000:01000000:3.0:1788642391.670911:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788642391.670980:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.670992:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.671001:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642391.671023:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788642391.671067:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642391.671131:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788642391.671354:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107437184 00000100:00100000:2.0:1788642391.671365:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107437184 00000100:00100000:2.0:1788642391.671449:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788642391.671464:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd7ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+5:14377:x1875527107437184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788642391.671482:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642391.671509:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e0c00/0x4ae1ee156666e197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e190 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642391.671542:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e0c00/0x4ae1ee156666e197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e190 expref: 6 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642391.671567:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e0c00/0x4ae1ee156666e197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e190 expref: 6 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642391.671577:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0c00, rc 0) 00000100:00100000:2.0:1788642391.671626:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd7ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+6:14377:x1875527107437184:12345-0@lo:101:mount.lustre.0 Request processed in 167us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642391.671635:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642391.672447:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788642391.672473:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e197 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642391.672485:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e197 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642391.672570:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6339c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788642391.672612:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642391.672652:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc656b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788642391.673225:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107437312 00000100:00100000:2.0:1788642391.673235:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107437312 00000100:00100000:2.0:1788642391.673318:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788642391.673331:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddce58cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+6:14377:x1875527107437312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788642391.674340:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6339c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437312:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788642391.674413:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788642391.674451:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e197 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.674466:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e197 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642391.674479:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dddf7f24800 10000000:01000000:3.0:1788642391.674488:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788642391.674496:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dddf7f24800 10000000:01000000:3.0:1788642391.674501:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788642391.674506:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dddf7f24800 from 1 10000000:01000000:3.0:1788642391.674521:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00000100:00100000:2.0:1788642391.675162:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddce58cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+6:14377:x1875527107437312:12345-0@lo:501:mount.lustre.0 Request processed in 1829us (2543us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788642391.675179:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788642391.675354:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa800/0x4ae1ee156666e19e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.675366:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa800/0x4ae1ee156666e19e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.675396:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa800/0x4ae1ee156666e19e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642391.675422:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788642391.675481:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642391.675528:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642391.675708:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107437440 00000100:00100000:1.0:1788642391.675716:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107437440 00000100:00100000:1.0:1788642391.675975:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788642391.675990:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+6:14377:x1875527107437440:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788642391.676006:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642391.676029:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfb3bb000/0x4ae1ee156666e1a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e19e expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.676058:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfb3bb000/0x4ae1ee156666e1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e19e expref: 7 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.676071:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfb3bb000/0x4ae1ee156666e1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e19e expref: 7 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.676081:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3bb000, rc 0) 00000100:00100000:1.0:1788642391.676140:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+7:14377:x1875527107437440:12345-0@lo:101:mount.lustre.0 Request processed in 156us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642391.676147:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788642391.676961:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788642391.676986:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa800/0x4ae1ee156666e19e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e1a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.676998:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa800/0x4ae1ee156666e19e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e1a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642391.677019:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788642391.677049:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa800/0x4ae1ee156666e19e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e1a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.677059:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa800/0x4ae1ee156666e19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e1a5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642391.677067:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788642391.677075:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788642391.677095:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dddf7f24800 10000000:01000000:3.0:1788642391.677126:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788642391.677132:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788642391.677136:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788642391.677172:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffab800/0x4ae1ee156666e1ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.677182:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddeffab800/0x4ae1ee156666e1ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.677194:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddeffab800/0x4ae1ee156666e1ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642391.677217:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788642391.677273:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642391.677330:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788642391.678160:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107437568 00000100:00100000:0.0:1788642391.678169:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107437568 00000100:00100000:0.0:1788642391.678236:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788642391.678249:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+7:14377:x1875527107437568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788642391.678264:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642391.678285:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfaa5ce00/0x4ae1ee156666e1b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e1ac expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642391.678330:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfaa5ce00/0x4ae1ee156666e1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e1ac expref: 8 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642391.678344:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfaa5ce00/0x4ae1ee156666e1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e1ac expref: 8 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642391.678354:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5ce00, rc 0) 00000100:00100000:0.0:1788642391.678436:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+8:14377:x1875527107437568:12345-0@lo:101:mount.lustre.0 Request processed in 189us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642391.678444:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788642391.680330:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788642391.680357:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddeffab800/0x4ae1ee156666e1ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e1b3 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.680378:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddeffab800/0x4ae1ee156666e1ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e1b3 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642391.680462:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788642391.680518:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642391.680645:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107437696 00000100:00100000:2.0:1788642391.680652:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107437696 00000100:00100000:2.0:1788642391.680704:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788642391.680714:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+8:14377:x1875527107437696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788642391.681359:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+9:14377:x1875527107437696:12345-0@lo:501:mount.lustre.0 Request processed in 642us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642391.681373:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788642391.682028:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788642391.682062:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788642391.682137:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788642391.682193:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642391.682233:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788642391.684569:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107437824 00000100:00100000:2.0:1788642391.684582:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107437824 00000100:00100000:2.0:1788642391.684673:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788642391.684686:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+9:14377:x1875527107437824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788642391.687398:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+9:14377:x1875527107437824:12345-0@lo:503:mount.lustre.0 Request processed in 2692us (5180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642391.687417:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788642391.688071:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107437824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788642391.689967:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14413:1875527107437952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642391.690054:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642391.690233:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642391.690281:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107437952 00000100:00100000:0.0:1788642391.690289:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107437952 00000100:00100000:0.0:1788642391.690509:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788642391.690520:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+9:14413:x1875527107437952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642391.691156:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+9:14413:x1875527107437952:12345-0@lo:502:llog_process_th.0 Request processed in 635us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642391.691165:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788642391.691355:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14413:1875527107437952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788642391.691421:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788642391.691447:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642391.691451:0:14413:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788642391.691460:0:14413:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788642391.691464:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788642391.691487:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dddeff44d40) 00000020:00000080:1.0:1788642391.691512:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788642391.691521:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788642391.691612:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788642391.691619:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666e1c1 00000020:00000080:1.0:1788642391.691949:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788642391.691957:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642391.691962:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642391.691964:0:14413:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788642391.691969:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788642391.691975:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642391.691977:0:14413:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788642391.691982:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788642391.691995:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dddeff419c0) 00000020:00000080:1.0:1788642391.692009:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788642391.692017:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788642391.692021:0:14413:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788642391.692025:0:14413:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788642391.692034:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788642391.692125:0:14413:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dddf7f24800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788642391.692139:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dddeff40000) 00000020:00000080:1.0:1788642391.692146:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788642391.692211:0:14413:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788642391.692221:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4ae1ee156666e1d6 00000020:00000080:1.0:1788642391.692363:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788642391.692373:0:14413:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788642391.692379:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4ae1ee156666e1dd 00080000:01000000:1.0:1788642391.692386:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788642391.692392:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666e1e4 00010000:00010000:2.0:1788642391.834948:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788642391.835593:0:14413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788642391.836251:0:14413:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788642391.837138:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dddfa7c3380) 00000020:00000080:3.0:1788642391.837261:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788642391.837393:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788642391.837407:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666e1f2 00000020:00000080:1.0:1788642391.837979:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788642391.849029:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4ae1ee156666e1f9 00000020:00000080:2.0:1788642391.849694:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788642391.849709:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642391.849716:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642391.849718:0:14413:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788642391.849723:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788642391.849726:0:14413:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788642391.849727:0:14413:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788642391.849729:0:14413:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788642391.849731:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788642391.849733:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642391.849734:0:14413:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788642391.849737:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788642391.849742:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642391.849743:0:14413:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788642391.849748:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788642391.849789:0:14413:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788642391.849805:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642391.849808:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642391.849809:0:14413:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788642391.849812:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788642391.849815:0:14413:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788642391.849820:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642391.849821:0:14413:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788642391.849823:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788642391.849828:0:14413:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.149@tcp to nid 0x20000c0a8ca95 (192.168.202.149@tcp) 00000020:01000000:2.0:1788642391.849869:0:14413:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788642391.849876:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788642391.849891:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dddfa7c19c0) 00000020:00000080:2.0:1788642391.849905:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788642391.849910:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788642391.849996:0:14413:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788642391.850005:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788642391.850015:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666e207 00010000:00080000:2.0:1788642391.850057:0:14413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dddc9ef3000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.149@tcp at head 00010000:00010000:2.0:1788642391.850327:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788642391.853599:0:14413:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788642391.853651:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788642391.860367:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788642391.860954:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788642391.861082:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788642391.871652:0:14418:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788642391.871663:0:14418:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788642391.872982:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788642391.872999:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788642391.873051:0:14413:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788642391.873077:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4ae1ee156666e20e 00000100:00080000:2.0:1788642391.873093:0:14413:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788642391.873365:0:14413:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dddc9ef3000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788642391.873417:0:14413:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfa882d80 x1875527107438080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788642391.873464:0:14413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788642391.873548:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642391.873553:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642391.873554:0:14413:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788642391.873558:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788642391.873561:0:14413:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788642391.873562:0:14413:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788642391.873564:0:14413:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788642391.873565:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788642391.873579:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642391.873581:0:14413:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788642391.873584:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788642391.873589:0:14413:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788642391.873592:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642391.873593:0:14413:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788642391.873596:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788642391.873600:0:14413:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.149@tcp to nid 0x20000c0a8ca95 (192.168.202.149@tcp) 00000020:01000000:2.0:1788642391.873625:0:14413:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788642391.873627:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788642391.873641:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dddfa7c0000) 00000020:00000080:2.0:1788642391.873653:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788642391.873657:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788642391.873732:0:14413:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788642391.873739:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788642391.873762:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4ae1ee156666e21c 00010000:00080000:2.0:1788642391.873791:0:14413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dddc9efa000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.149@tcp at head 00010000:00010000:2.0:1788642391.874118:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788642391.874380:0:14413:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788642391.874403:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788642391.874968:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788642391.875038:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788642391.875125:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1788642391.875735:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107438080:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788642391.875838:0:3316:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527107438080 offset 0 length 520: 4 00000040:00080000:0.0:1788642391.877003:0:14420:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788642391.877009:0:14420:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788642391.877777:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788642391.877789:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788642391.877821:0:14413:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788642391.877839:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4ae1ee156666e223 00000100:00080000:0.0:1788642391.877848:0:14413:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788642391.877854:0:14413:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dddc9efa000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:0.0:1788642391.877903:0:14413:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ddcc6339880 x1875527107438208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788642391.877931:0:14413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788642391.878009:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642391.878013:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642391.878014:0:14413:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788642391.878017:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642391.878022:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642391.878025:0:14413:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788642391.878031:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788642391.878033:0:14413:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788642391.878037:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642391.878052:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642391.878055:0:14413:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788642391.878061:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642391.878066:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642391.878068:0:14413:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788642391.878075:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788642391.878152:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14413:1875527107438336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642391.878256:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642391.878317:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc656bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788642391.878557:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107438208:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788642391.878595:0:3316:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527107438208 offset 0 length 520: 4 00000100:00100000:2.0:1788642391.878780:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107438336 00000100:00100000:2.0:1788642391.878788:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107438336 00000100:00100000:2.0:1788642391.878944:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788642391.878971:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+9:14413:x1875527107438336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642391.879303:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+9:14413:x1875527107438336:12345-0@lo:502:llog_process_th.0 Request processed in 337us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642391.879312:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788642391.879446:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14413:1875527107438336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788642391.879477:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642391.879483:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642391.879484:0:14413:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788642391.879488:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788642391.879707:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788642391.879733:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788642391.879759:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffab800/0x4ae1ee156666e1ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e1b3 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.879770:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddeffab800/0x4ae1ee156666e1ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e1b3 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642391.879778:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dddf7f24800 from 1 10000000:01000000:1.0:1788642391.879781:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788642391.879811:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.879820:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.879829:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642391.879847:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107438464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788642391.879880:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642391.882829:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788642391.883213:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107438464 00000100:00100000:3.0:1788642391.883227:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107438464 00000100:00100000:3.0:1788642391.883301:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788642391.883315:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+9:14377:x1875527107438464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788642391.883338:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642391.883360:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddeffab600/0x4ae1ee156666e231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e22a expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.883384:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddeffab600/0x4ae1ee156666e231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e22a expref: 10 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.883395:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddeffab600/0x4ae1ee156666e231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e22a expref: 10 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.883520:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffab600, rc 0) 00000100:00100000:3.0:1788642391.883674:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+10:14377:x1875527107438464:12345-0@lo:101:mount.lustre.0 Request processed in 363us (3792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642391.883682:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788642391.883935:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107438464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788642391.883974:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e231 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.883988:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e231 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642391.885035:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107438592:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788642391.885382:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642391.885583:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788642391.885625:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107438592 00000100:00100000:2.0:1788642391.885633:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107438592 00000100:00100000:2.0:1788642391.885712:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788642391.885722:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+10:14377:x1875527107438592:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788642391.885920:0:14389:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788642391.885933:0:14389:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788642391.886088:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+10:14377:x1875527107438592:12345-0@lo:256:mount.lustre.0 Request processed in 364us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642391.886152:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788642391.886387:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107438592:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788642391.887646:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788642391.887674:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e231 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.887685:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e231 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642391.887693:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddf7f24800 from 1 10000000:01000000:1.0:1788642391.887696:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788642391.887734:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.887828:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.887840:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642391.887863:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107438720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788642391.887921:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642391.888942:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788642391.889087:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107438720 00000100:00100000:3.0:1788642391.889125:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107438720 00000100:00100000:3.0:1788642391.889197:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788642391.889210:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+10:14377:x1875527107438720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788642391.889231:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642391.889251:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddeffaa000/0x4ae1ee156666e23f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e238 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.889286:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddeffaa000/0x4ae1ee156666e23f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e238 expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.889300:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddeffaa000/0x4ae1ee156666e23f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e238 expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.889310:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaa000, rc 0) 00000100:00100000:3.0:1788642391.889369:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14377:x1875527107438720:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642391.889376:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788642391.889584:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107438720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788642391.889650:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e23f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.889659:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e23f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642391.889721:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107438848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788642391.889771:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642391.889793:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788642391.890139:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107438848 00000100:00100000:3.0:1788642391.890148:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107438848 00000100:00100000:3.0:1788642391.890189:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788642391.890200:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14377:x1875527107438848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788642391.890714:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14377:x1875527107438848:12345-0@lo:501:mount.lustre.0 Request processed in 516us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642391.890728:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788642391.891173:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107438848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788642391.891230:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107438976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788642391.891299:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642391.891345:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788642391.891441:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107438976 00000100:00100000:3.0:1788642391.891451:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107438976 00000100:00100000:3.0:1788642391.891510:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788642391.891523:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14377:x1875527107438976:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788642391.891688:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14377:x1875527107438976:12345-0@lo:503:mount.lustre.0 Request processed in 169us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642391.891695:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788642391.891970:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107438976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788642391.892605:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa881c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14422:1875527107439104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642391.892652:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642391.892715:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4e6a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642391.892752:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107439104 00000100:00100000:3.0:1788642391.892758:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107439104 00000100:00100000:3.0:1788642391.892855:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788642391.892869:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14422:x1875527107439104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642391.893279:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14422:x1875527107439104:12345-0@lo:502:llog_process_th.0 Request processed in 412us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642391.893290:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788642391.893399:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa881c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14422:1875527107439104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788642391.893442:0:14422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642391.893451:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642391.893454:0:14422:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788642391.893461:0:14422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dddf7f24800 00000020:00000080:0.0:1788642391.893464:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788642391.893471:0:14422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642391.893474:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642391.893475:0:14422:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788642391.893478:0:14422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642391.893480:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642391.893481:0:14422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788642391.893485:0:14422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dddf7f24800 00000020:00000080:0.0:1788642391.893487:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788642391.893546:0:14422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642391.893549:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642391.893550:0:14422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788642391.893560:0:14422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642391.893563:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642391.893564:0:14422:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788642391.893568:0:14422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dddf7f24800 00000020:00000080:0.0:1788642391.893570:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788642391.893611:0:14422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14422:1875527107439232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788642391.893648:0:14422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642391.904602:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107439232 00000100:00100000:2.0:1788642391.904619:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107439232 00000100:00100000:2.0:1788642391.904691:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788642391.904702:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14422:x1875527107439232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642391.904992:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14422:x1875527107439232:12345-0@lo:502:llog_process_th.0 Request processed in 290us (11342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642391.905001:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788642391.905652:0:14422:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc656bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788642391.905681:0:14422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14422:1875527107439232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788642391.905718:0:14422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642391.905727:0:14422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642391.905729:0:14422:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788642391.905735:0:14422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788642391.908134:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788642391.908158:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788642391.908178:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e23f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.908194:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e23f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642391.908266:0:14377:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788642391.908271:0:14377:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dddf7f24800 10000000:01000000:1.0:1788642391.908274:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dddf7f24800 10000000:01000000:1.0:1788642391.908279:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788642391.908288:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dddf7f24800 from 1 10000000:01000000:1.0:1788642391.908292:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788642391.908338:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bba00/0x4ae1ee156666e246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.908347:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bba00/0x4ae1ee156666e246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.908360:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bba00/0x4ae1ee156666e246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642391.908393:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107439360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788642391.908462:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642391.908504:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc9373300 going to sleep for 11 seconds 00000100:00100000:3.0:1788642391.910911:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107439360 00000100:00100000:3.0:1788642391.910928:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107439360 00000100:00100000:3.0:1788642391.911020:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788642391.911030:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14377:x1875527107439360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788642391.911047:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642391.911065:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddeffabc00/0x4ae1ee156666e24d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e246 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.911093:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddeffabc00/0x4ae1ee156666e24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e246 expref: 12 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.911136:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddeffabc00/0x4ae1ee156666e24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e246 expref: 12 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.911160:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffabc00, rc 0) 00000100:00100000:3.0:1788642391.911243:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14377:x1875527107439360:12345-0@lo:101:mount.lustre.0 Request processed in 214us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642391.911249:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788642391.915876:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107439360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788642391.915908:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bba00/0x4ae1ee156666e246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e24d expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642391.915921:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bba00/0x4ae1ee156666e246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e24d expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642391.916019:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107439488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788642391.916088:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642391.916167:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc9373300 going to sleep for 11 seconds 00000100:00100000:2.0:1788642391.919833:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107439488 00000100:00100000:2.0:1788642391.919846:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107439488 00000100:00100000:2.0:1788642391.919897:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788642391.919906:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14377:x1875527107439488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788642391.920387:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14377:x1875527107439488:12345-0@lo:501:mount.lustre.0 Request processed in 476us (4294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642391.920400:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788642391.924933:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107439488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788642391.925015:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107439616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788642391.926251:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642391.926374:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc9373300 going to sleep for 11 seconds 00000100:00100000:3.0:1788642391.934271:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107439616 00000100:00100000:3.0:1788642391.934287:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107439616 00000100:00100000:0.0:1788642391.935355:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788642391.935374:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14377:x1875527107439616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788642391.935689:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14377:x1875527107439616:12345-0@lo:503:mount.lustre.0 Request processed in 318us (10588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642391.935700:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788642391.937386:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107439616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788642391.938425:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa883480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14428:1875527107439744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788642391.938523:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642391.939915:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4e6a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788642391.940510:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107439744 00000100:00100000:3.0:1788642391.940520:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107439744 00000100:00100000:3.0:1788642391.940576:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788642391.940585:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14428:x1875527107439744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642391.941021:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14428:x1875527107439744:12345-0@lo:502:llog_process_th.0 Request processed in 436us (2498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642391.941029:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788642391.947057:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa883480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14428:1875527107439744:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788642391.947162:0:14428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788642391.947181:0:14428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dddfa7c4d40) 00000020:00000080:2.0:1788642391.947202:0:14428:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788642391.947298:0:14428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dddf7f24800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788642391.947302:0:14428:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dddf7f24800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788642391.947304:0:14428:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dddf7f24800 4 00010000:00080000:2.0:1788642391.947328:0:14428:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dddc9ef8000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.149@tcp at head 00010000:00010000:3.0:1788642391.954670:0:14428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788642391.954987:0:14428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788642391.955061:0:14428:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788642391.955082:0:14428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4ae1ee156666e25b 00000100:00080000:3.0:1788642391.955095:0:14428:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788642391.955138:0:14428:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dddc9ef8000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788642391.955186:0:14428:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfb40d180 x1875527107439872/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788642391.955227:0:14428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788642391.955389:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875527107439872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788642391.955477:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642391.956182:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107439872 00000100:00100000:3.0:1788642391.956195:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107439872 00000100:00100000:3.0:1788642391.956252:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788642391.956263:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1875527107439872:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788642391.956365:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1875527107439872:12345-0@lo:38:llog_process_th.0 Request processed in 103us (889us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788642391.956372:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788642391.956426:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788642391.956433:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddc9ef8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788642391.956442:0:3316:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788642391.956445:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875527107439872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788642391.956545:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14428:1875527107440000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642391.956604:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642391.956630:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788642391.956644:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107440000 00000100:00100000:3.0:1788642391.956647:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107440000 00000100:00100000:3.0:1788642391.956677:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788642391.956684:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14428:x1875527107440000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788642391.957225:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14428:x1875527107440000:12345-0@lo:502:llog_process_th.0 Request processed in 538us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642391.957234:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788642391.957283:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14428:1875527107440000:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788642391.957305:0:14428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788642391.957362:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788642391.957384:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788642391.957400:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bba00/0x4ae1ee156666e246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e24d expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642391.957413:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bba00/0x4ae1ee156666e246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e24d expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788642391.957504:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788642391.957507:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788642391.957509:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642391.957510:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642391.957512:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642391.957514:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642391.957515:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788642391.957517:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788642391.957520:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642391.957521:0:14377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788642391.957528:0:14377:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788642391.957532:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788642391.957534:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788642391.957535:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642391.957536:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642391.957537:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642391.957539:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642391.957540:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788642391.957541:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788642391.957542:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642391.957543:0:14377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788642391.957586:0:14377:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788642391.957599:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107440128:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788642391.957649:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642391.957678:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788642391.957705:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107440128 00000100:00100000:3.0:1788642391.957713:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107440128 00000100:00100000:3.0:1788642391.957761:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788642391.957771:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14377:x1875527107440128:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788642391.958550:0:14387:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788642391.958669:0:14387:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788642392.035315:0:14387:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788642392.035346:0:14387:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788642392.035492:0:14411:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788642392.035499:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788642392.035533:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642392.035558:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddeffab600/0x4ae1ee156666e231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e22a expref: 12 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642392.035568:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642392.035643:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddeffab600/0x4ae1ee156666e231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666e22a expref: 12 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642392.035657:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddeffab600/0x4ae1ee156666e231 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666e22a expref: 12 pid: 14387 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642392.035694:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1875527107440256:0@lo:104: 00000100:00100000:2.0:1788642392.035779:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642392.035872:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4e6a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788642392.036371:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107440256 00000100:00100000:1.0:1788642392.036381:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107440256 00000100:00100000:1.0:1788642392.036456:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788642392.036470:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+3:14411:x1875527107440256:12345-0@lo:104: 00010000:00010000:1.0:1788642392.036487:0:14378:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e231 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.036567:0:14378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788642392.036591:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+3:14411:x1875527107440256:12345-0@lo:104: Request processed in 109us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642392.036612:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788642392.036635:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642392.036640:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e231 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.036647:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bbc00 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:1.0:1788642392.036652:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666e231 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.036660:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666e231 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788642392.036674:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666e231 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642392.036680:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788642392.036712:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e231 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.036718:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788642392.036737:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e231 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.036746:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e22a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e231 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.036766:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642392.036768:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642392.036770:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642392.037041:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3317:1875527107440384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788642392.037077:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642392.037174:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107440384 00000100:00100000:1.0:1788642392.037178:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107440384 00010000:00010000:1.0:1788642392.037195:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddeffab600/0x4ae1ee156666e231 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e22a expref: 13 pid: 14387 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642392.037215:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788642392.037222:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+13:3317:x1875527107440384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788642392.037232:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642392.037237:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddeffab600/0x4ae1ee156666e231 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e22a expref: 13 pid: 14387 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037255:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddeffab600/0x4ae1ee156666e231 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666e22a expref: 13 pid: 14387 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037272:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037280:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788642392.037294:0:14380:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001795938s 00010000:00010000:1.0:1788642392.037298:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037305:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037311:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037317:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037323:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642392.037328:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037335:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037343:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037358:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642392.037390:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+13:3317:x1875527107440384:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642392.037397:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788642392.037446:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3317:1875527107440384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788642392.037475:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddeffab600/0x4ae1ee156666e231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666e22a expref: 12 pid: 14387 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642392.037485:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1875527107440256:0@lo:104: 00010000:00010000:1.0:1788642392.037498:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037508:0:14411:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037513:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.037519:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e262 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642392.055382:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14377:x1875527107440128:12345-0@lo:253:mount.lustre.0 Request processed in 97599us (97721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642392.055404:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788642392.055540:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14377:1875527107440128:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788642392.055561:0:14377:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788642392.055727:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788642392.055730:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788642392.055731:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642392.055732:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642392.055734:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642392.055735:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642392.055736:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788642392.055738:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788642392.055740:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642392.055913:0:14377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788642392.055937:0:14377:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788642392.070270:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788642392.070508:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788642392.073273:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788642392.077063:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788642392.078466:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788642392.078903:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788642392.080358:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788642392.081434:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788642392.083505:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788642392.084353:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788642392.084670:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788642392.084862:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788642392.131301:0:14377:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788642392.134982:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788642392.135417:0:14435:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788642392.135424:0:14435:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788642392.138732:0:14436:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788642392.139141:0:14436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788642392.151571:0:14436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788642392.152417:0:14436:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788642392.152423:0:14436:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1788642392.161573:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788642392.162045:0:14377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788642392.167458:0:14377:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788642392.167487:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788642392.169729:0:14377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788642392.171185:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788642392.174462:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788642392.174553:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788642392.178352:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788642392.198976:0:14377:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788642392.262667:0:14377:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788642392.262706:0:14377:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3a44174f988 00100000:10000000:3.0:1788642392.262714:0:14377:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788642392.263875:0:14377:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788642392.263907:0:14377:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.149@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788642392.263926:0:14377:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788642392.263960:0:14377:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788642392.320230:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788642392.574403:0:14393:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788642392.574411:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dddf7f24800 from 6 10000000:01000000:2.0:1788642392.574414:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788642392.574461:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642392.574473:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642392.574484:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642392.574508:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa881f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107440512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788642392.574581:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642392.574632:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc537c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788642392.574916:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107440512 00000100:00100000:1.0:1788642392.574924:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107440512 00000100:00100000:1.0:1788642392.574978:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788642392.574987:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14393:x1875527107440512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788642392.575001:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642392.575015:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e270 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e269 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.575037:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e269 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.575047:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e269 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.575067:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3bae00, rc 0) 00000100:00100000:1.0:1788642392.575133:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14393:x1875527107440512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642392.575140:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788642392.575192:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa881f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107440512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788642392.575206:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e270 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.575214:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e270 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642392.575264:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107440640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788642392.575300:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642392.575314:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc9373540 going to sleep for 11 seconds 00000100:00100000:1.0:1788642392.575326:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107440640 00000100:00100000:1.0:1788642392.575330:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107440640 00000100:00100000:1.0:1788642392.575352:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788642392.575374:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14393:x1875527107440640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788642392.575387:0:14387:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788642392.575401:0:14387:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788642392.575403:0:14387:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788642392.575481:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14393:x1875527107440640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642392.575488:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788642392.575518:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107440640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788642392.575556:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788642392.575563:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e270 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642392.575571:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e270 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788642392.958961:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788642393.338350:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788642393.981621:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788642394.362528:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642395.390413:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642396.414879:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788642397.371762:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788642397.371769:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788642397.371772:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788642397.371775:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788642397.371777:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788642397.371779:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788642397.371784:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dddc9ef8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788642397.371807:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dddc9ef8000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788642397.371897:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfb40fb80 x1875527107440896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788642397.371930:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3318:1875527107440768:0@lo:400:kworker.0 00000100:00100000:3.0:1788642397.372010:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642397.372086:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107440768 00000100:00100000:3.0:1788642397.372094:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107440768 00000100:00100000:3.0:1788642397.372156:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788642397.372165:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:3318:x1875527107440768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642397.372224:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:3318:x1875527107440768:12345-0@lo:400:kworker.0 Request processed in 61us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642397.372231:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788642397.372280:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3318:1875527107440768:0@lo:400:kworker.0 00000100:00100000:2.0:1788642397.372642:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875527107440896:0@lo:38:kworker.0 00000100:00100000:2.0:1788642397.372680:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642397.376368:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107440896 00000100:00100000:0.0:1788642397.376387:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107440896 00000100:00100000:0.0:1788642397.376444:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788642397.376453:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1875527107440896:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788642397.376489:0:14397:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1788642397.377618:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4ae1ee156666e277 00000004:00100000:0.0:1788642397.377642:0:14397:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788642397.377811:0:14397:0:(import.c:65:import_set_state_nolock()) ffff8ddcc4917800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788642397.377932:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875527107440896:12345-0@lo:38:kworker.0 Request processed in 1477us (5249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642397.377943:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788642397.382806:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dddfb40fb80 x1875527107440896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788642407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788642397.382833:0:3316:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788642397.382842:0:3316:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788642397.382848:0:3316:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788642397.382851:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddc9ef8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788642397.382859:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875527107440896:0@lo:38:kworker.0 00010000:00010000:1.0:1788642397.434372:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788642397.960600:0:14679:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788642398.458404:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642399.483227:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642400.507249:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642401.466346:0:3316:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788642391/real 1788642391] req@ffff8ddcc6339880 x1875527107438208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788642401 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642401.466386:0:3316:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ddcc6339880 x1875527107438208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788642401 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642401.466398:0:3316:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788642391/real 1788642391] req@ffff8dddfa882d80 x1875527107438080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788642401 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642401.466408:0:3316:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dddfa882d80 x1875527107438080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788642401 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788642401.466429:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddc9efa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788642401.466495:0:3316:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788642401.466499:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107438208:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788642401.466505:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddc9ef3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788642401.468921:0:3316:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788642401.468931:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107438080:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788642401.469056:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788642401.469061:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788642401.469064:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dddc9ef3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788642401.469069:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 479 00000100:00080000:1.0:1788642401.469074:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788642401.469079:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dddc9ef3000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:1.0:1788642401.469115:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfad1e680 x1875527107441152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788642401.469128:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788642401.469132:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788642401.469133:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dddc9efa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788642401.469136:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 479 00000100:00080000:1.0:1788642401.469139:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788642401.469142:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dddc9efa000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:1.0:1788642401.469165:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfad1df80 x1875527107441280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788642401.469234:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107441024:0@lo:400:kworker.0 00000100:00100000:0.0:1788642401.469299:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642401.469341:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642401.469346:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107441408:0@lo:400:kworker.0 00000100:00100000:0.0:1788642401.469374:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642401.469415:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107441408 00000100:00100000:0.0:1788642401.469422:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107441408 00000100:00100000:0.0:1788642401.469469:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788642401.469477:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107441408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642401.469525:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107441408:12345-0@lo:400:kworker.0 Request processed in 48us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642401.469544:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788642401.469583:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dddfad1f800 x1875527107441408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642401.469595:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107441408:0@lo:400:kworker.0 00000100:00100000:0.0:1788642401.469612:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107441152:0@lo:8:kworker.0 00000400:00000100:0.0:1788642401.469648:0:3316:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527107441152 offset 0 length 520: 4 00000100:00100000:0.0:1788642401.469662:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107441280:0@lo:8:kworker.0 00000400:00000100:0.0:1788642401.469680:0:3316:0:(lib-move.c:4368:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875527107441280 offset 0 length 520: 4 00000100:00100000:2.0:1788642401.470315:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107441024 00000100:00100000:2.0:1788642401.470322:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107441024 00000100:00100000:2.0:1788642401.470364:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788642401.470373:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:3319:x1875527107441024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642401.470422:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:3319:x1875527107441024:12345-0@lo:400:kworker.0 Request processed in 51us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642401.470430:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788642401.470470:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107441024:0@lo:400:kworker.0 00010000:00010000:1.0:1788642401.531443:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788642401.868861:0:14830:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd782bbbe0 20000000:00000080:3.0:1788642401.868880:0:14830:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dddc929e000 uarg=0000000000000000 20000000:01000000:3.0:1788642401.868918:0:14830:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788642401.868926:0:14830:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788642401.868931:0:14830:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788642401.871659:0:14831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788642401.871815:0:14830:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788642401.889079:0:14830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788642401.889295:0:14830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642401.889317:0:14830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddeffaa000/0x4ae1ee156666e23f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e238 expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642401.889325:0:14830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642401.889375:0:14830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddeffaa000/0x4ae1ee156666e23f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666e238 expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642401.889391:0:14830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddeffaa000/0x4ae1ee156666e23f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666e238 expref: 11 pid: 14387 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642401.889423:0:14830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14830:1875527107441536:0@lo:104: 00000100:00100000:0.0:1788642401.889493:0:14830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642401.889560:0:14830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5eea180 going to sleep for 11 seconds 00000100:00100000:2.0:1788642401.889967:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107441536 00000100:00100000:2.0:1788642401.889976:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107441536 00000100:00100000:2.0:1788642401.890027:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788642401.890037:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+3:14830:x1875527107441536:12345-0@lo:104: 00010000:00010000:2.0:1788642401.890053:0:14379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e23f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890158:0:14379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788642401.890165:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+3:14830:x1875527107441536:12345-0@lo:104: Request processed in 129us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642401.890173:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788642401.890195:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788642401.890202:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e23f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890209:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bb200 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:2.0:1788642401.890213:0:14383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666e23f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890223:0:14383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666e23f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788642401.890230:0:14383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666e23f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788642401.890236:0:14383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788642401.890266:0:14383:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e23f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890272:0:14383:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788642401.890294:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e23f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890302:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb200/0x4ae1ee156666e238 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e23f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890342:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642401.890343:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642401.890345:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642401.890366:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3317:1875527107441664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788642401.890399:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642401.890444:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107441664 00000100:00100000:2.0:1788642401.890448:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107441664 00010000:00010000:2.0:1788642401.890465:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddeffaa000/0x4ae1ee156666e23f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e238 expref: 12 pid: 14387 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642401.890485:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788642401.890490:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:3317:x1875527107441664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788642401.890501:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788642401.890506:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddeffaa000/0x4ae1ee156666e23f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e238 expref: 12 pid: 14387 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890516:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddeffaa000/0x4ae1ee156666e23f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666e238 expref: 12 pid: 14387 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890534:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890543:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890557:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890565:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890578:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890584:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890590:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5ca00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642401.890594:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890602:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890610:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642401.890619:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788642401.890648:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:3317:x1875527107441664:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642401.890655:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788642401.890693:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3317:1875527107441664:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642401.891066:0:14830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddeffaa000/0x4ae1ee156666e23f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666e238 expref: 11 pid: 14387 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642401.891078:0:14830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14830:1875527107441536:0@lo:104: 00010000:00010000:0.0:1788642401.891092:0:14830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642401.891136:0:14830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642401.891154:0:14830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642401.891161:0:14830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfaa5ca00/0x4ae1ee156666e27e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642402.555269:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788642403.200230:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788642403.453245:0:14393:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788642403.453253:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddf7f24800 from 10 10000000:01000000:2.0:1788642403.453259:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788642403.453306:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642403.453318:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642403.453341:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642403.453366:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107441792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788642403.453430:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642403.453486:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc8c7c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642403.453556:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107441792 00000100:00100000:0.0:1788642403.453565:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107441792 00000100:00100000:0.0:1788642403.453623:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788642403.453633:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+11:14393:x1875527107441792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788642403.453646:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642403.453661:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfaa5c000/0x4ae1ee156666e28c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e285 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642403.453684:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfaa5c000/0x4ae1ee156666e28c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e285 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642403.453704:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfaa5c000/0x4ae1ee156666e28c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e285 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642403.453713:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5c000, rc 0) 00000100:00100000:0.0:1788642403.453752:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14393:x1875527107441792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642403.453772:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788642403.454022:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107441792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642403.454036:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e28c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642403.454046:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e28c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642403.454140:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107441920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788642403.454167:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642403.454184:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc8c7c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642403.454310:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107441920 00000100:00100000:0.0:1788642403.454314:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107441920 00000100:00100000:0.0:1788642403.454344:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788642403.454350:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14393:x1875527107441920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642403.454646:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14393:x1875527107441920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642403.454654:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788642403.454715:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107441920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788642403.454756:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107442048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788642403.454799:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642403.454826:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc8c7c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642403.454914:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107442048 00000100:00100000:3.0:1788642403.454927:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107442048 00000100:00100000:3.0:1788642403.454957:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788642403.454963:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14393:x1875527107442048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642403.455121:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:14393:x1875527107442048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642403.455142:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788642403.455175:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107442048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788642403.455867:0:14897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788642403.455918:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788642403.455939:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788642403.455948:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e28c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642403.455958:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e28c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642403.578424:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642404.602316:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642405.626609:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788642406.588489:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788642406.588496:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788642406.588508:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788642406.588511:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788642406.588551:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3318:1875527107442176:0@lo:400:kworker.0 00000100:00100000:2.0:1788642406.588625:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642406.588905:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788642406.588923:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107442304:0@lo:400:kworker.0 00000100:00100000:0.0:1788642406.588957:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642406.589092:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107442304 00000100:00100000:0.0:1788642406.589129:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107442304 00000100:00100000:0.0:1788642406.589185:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788642406.589194:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107442304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642406.594519:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107442176 00000100:00100000:2.0:1788642406.594538:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107442176 00000100:00100000:2.0:1788642406.594598:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788642406.594608:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:3318:x1875527107442176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642406.594884:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:3318:x1875527107442176:12345-0@lo:400:kworker.0 Request processed in 275us (6257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642406.594961:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788642406.595092:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3318:1875527107442176:0@lo:400:kworker.0 00000100:00100000:0.0:1788642406.596006:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875527107442304:12345-0@lo:400:kworker.0 Request processed in 6805us (7041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642406.596018:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788642406.596224:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dddfa883100 x1875527107442304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642406.596258:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875527107442304:0@lo:400:kworker.0 00010000:00010000:1.0:1788642406.651229:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788642407.404945:0:15079:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788642407.404949:0:15079:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788642407.405063:0:15079:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ddde4e39000 00000020:01000004:2.0:1788642407.405081:0:15079:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788642407.405131:0:15079:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788642407.405148:0:15079:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8dddc6343380) 00000020:00000080:2.0:1788642407.405164:0:15079:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788642407.414716:0:15079:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788642407.414940:0:15079:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788642407.415564:0:15079:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788642407.415737:0:15079:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788642407.415885:0:15079:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788642407.416293:0:15079:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1788642407.416357:0:15079:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1788642407.416430:0:15079:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1788642407.416737:0:15079:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 430: rc = 0 00100000:10000000:2.0:1788642407.417642:0:15079:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 430: rc = 0 00100000:10000000:2.0:1788642407.417837:0:15079:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 430: rc = 0 00100000:10000000:2.0:1788642407.418029:0:15079:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 430: rc = 0 00100000:10000000:2.0:1788642407.418435:0:15079:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 430: rc = 0 00100000:10000000:2.0:1788642407.418646:0:15079:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 430: rc = 0 00000020:00000080:2.0:1788642407.419182:0:15079:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788642407.419193:0:15079:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788642407.419205:0:15079:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4ae1ee156666e29a 00000020:01000004:2.0:1788642407.419212:0:15079:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788642407.419232:0:15079:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.149@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788642407.419234:0:15079:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788642407.419239:0:15079:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788642407.419242:0:15079:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788642407.419251:0:15079:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8dddc6340000) 00000020:00000080:2.0:1788642407.419258:0:15079:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788642407.420357:0:15079:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788642407.420486:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788642407.420490:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788642407.422509:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788642407.422525:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788642407.422906:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788642407.422913:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788642407.424723:0:15079:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788642407.424897:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788642407.424904:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788642407.427492:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788642407.427503:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788642407.439363:0:15079:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788642407.439614:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788642407.439621:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788642407.442144:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788642407.442158:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788642407.442852:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788642407.442859:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788642407.444676:0:15079:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788642407.444963:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788642407.444972:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788642407.445616:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788642407.445624:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788642407.475140:0:15079:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788642407.475355:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788642407.475361:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788642407.476412:0:15079:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788642407.476421:0:15079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788642407.476751:0:15079:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788642407.476776:0:15079:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788642407.476782:0:15079:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.149@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788642407.495642:0:15079:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788642407.495678:0:15079:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.149@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788642407.495682:0:15079:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788642407.495684:0:15079:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788642407.495686:0:15079:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788642407.495687:0:15079:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788642407.495689:0:15079:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788642407.495690:0:15079:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788642407.495691:0:15079:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788642407.495693:0:15079:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788642407.495694:0:15079:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788642407.495699:0:15079:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788642407.495701:0:15079:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788642407.495703:0:15079:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788642407.495704:0:15079:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788642407.495705:0:15079:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788642407.495706:0:15079:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788642407.495707:0:15079:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788642407.495708:0:15079:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788642407.495709:0:15079:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788642407.495711:0:15079:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788642407.495739:0:15079:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788642407.495761:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107442432:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788642407.495835:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642407.495899:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5dc9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788642407.495978:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107442432 00000100:00100000:0.0:1788642407.495985:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107442432 00000100:00100000:0.0:1788642407.496032:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788642407.496043:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:15079:x1875527107442432:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788642407.496075:0:14389:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788642407.496079:0:14389:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788642407.496083:0:14389:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788642407.500385:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:15079:x1875527107442432:12345-0@lo:253:mount.lustre.0 Request processed in 4335us (4539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642407.500401:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788642407.500416:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107442432:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788642407.500434:0:15079:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788642407.500437:0:15079:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788642407.500439:0:15079:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788642407.500441:0:15079:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788642407.500442:0:15079:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788642407.500444:0:15079:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788642407.500445:0:15079:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788642407.500446:0:15079:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788642407.500448:0:15079:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788642407.500449:0:15079:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788642407.500469:0:15079:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ddde4e39000 from lustre-OST0000 10000000:01000000:1.0:1788642407.500502:0:15079:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788642407.500505:0:15079:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788642407.500511:0:15079:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dddc4e019c0 local copy 00010000:00010000:1.0:1788642407.500521:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e197 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642407.500838:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107442560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788642407.500876:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642407.500916:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5dc9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788642407.501479:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107442560 00000100:00100000:2.0:1788642407.501487:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107442560 00000100:00100000:2.0:1788642407.501549:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788642407.501559:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:15079:x1875527107442560:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788642407.501760:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:15079:x1875527107442560:12345-0@lo:501:mount.lustre.0 Request processed in 201us (882us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788642407.501767:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788642407.501962:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107442560:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788642407.501975:0:15079:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788642407.502072:0:15079:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788642407.502079:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e197 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.502146:0:15079:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e197 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642407.502176:0:15079:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ddde4e39000 10000000:01000000:0.0:1788642407.502217:0:15079:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788642407.502225:0:15079:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8dddc4e019c0 10000000:01000000:0.0:1788642407.502229:0:15079:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788642407.502233:0:15079:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dddc4e019c0 from 1 10000000:01000000:0.0:1788642407.502236:0:15079:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788642407.502267:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfaa5c400/0x4ae1ee156666e2a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642407.502277:0:15079:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfaa5c400/0x4ae1ee156666e2a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642407.502286:0:15079:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfaa5c400/0x4ae1ee156666e2a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642407.502304:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6338700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107442688:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788642407.502338:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642407.502431:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc4e6a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642407.502476:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107442688 00000100:00100000:2.0:1788642407.502482:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107442688 00000100:00100000:2.0:1788642407.502672:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788642407.502682:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+12:15079:x1875527107442688:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788642407.502692:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642407.502705:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e0400/0x4ae1ee156666e2af lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e2a8 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642407.502726:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e0400/0x4ae1ee156666e2af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e2a8 expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642407.502749:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e0400/0x4ae1ee156666e2af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e2a8 expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642407.502758:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0400, rc 0) 00000100:00100000:2.0:1788642407.502806:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+13:15079:x1875527107442688:12345-0@lo:101:mount.lustre.0 Request processed in 125us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642407.502812:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788642407.502853:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6338700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107442688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788642407.502868:0:15079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfaa5c400/0x4ae1ee156666e2a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e2af expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642407.502879:0:15079:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfaa5c400/0x4ae1ee156666e2a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e2af expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642407.502896:0:15079:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788642407.502924:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfaa5c400/0x4ae1ee156666e2a8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e2af expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642407.502932:0:15079:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfaa5c400/0x4ae1ee156666e2a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e2af expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642407.502938:0:15079:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788642407.502943:0:15079:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788642407.502948:0:15079:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788642407.502950:0:15079:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788642407.502966:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa600/0x4ae1ee156666e2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642407.502974:0:15079:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa600/0x4ae1ee156666e2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642407.502981:0:15079:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa600/0x4ae1ee156666e2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642407.502994:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107442816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788642407.503025:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642407.503052:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc53b0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788642407.503154:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107442816 00000100:00100000:1.0:1788642407.503158:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107442816 00000100:00100000:1.0:1788642407.503191:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788642407.503199:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+13:15079:x1875527107442816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788642407.503207:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642407.503217:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfb3baa00/0x4ae1ee156666e2bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e2b6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.503232:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfb3baa00/0x4ae1ee156666e2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e2b6 expref: 14 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.503241:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfb3baa00/0x4ae1ee156666e2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e2b6 expref: 14 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.503249:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3baa00, rc 0) 00000100:00100000:1.0:1788642407.503326:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+14:15079:x1875527107442816:12345-0@lo:101:mount.lustre.0 Request processed in 128us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642407.503337:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788642407.503394:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107442816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788642407.503404:0:15079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa600/0x4ae1ee156666e2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e2bd expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642407.503412:0:15079:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa600/0x4ae1ee156666e2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e2bd expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788642407.504224:0:15079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788642407.505319:0:15079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788642407.505673:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788642407.505799:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788642407.505836:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788642407.505885:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788642407.505924:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788642407.505959:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788642407.506045:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788642407.506053:0:15079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788642407.506193:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107442944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788642407.506260:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642407.506313:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0a2d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788642407.506334:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107442944 00000100:00100000:2.0:1788642407.506343:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107442944 00000100:00100000:2.0:1788642407.506405:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788642407.506416:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+14:15079:x1875527107442944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788642407.507188:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+14:15079:x1875527107442944:12345-0@lo:501:mount.lustre.0 Request processed in 772us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642407.507197:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788642407.507216:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107442944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788642407.507256:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788642407.507294:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642407.507371:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0a2d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788642407.507402:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107443072 00000100:00100000:1.0:1788642407.507407:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107443072 00000100:00100000:1.0:1788642407.507438:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788642407.507445:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+14:15079:x1875527107443072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788642407.507891:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+14:15079:x1875527107443072:12345-0@lo:503:mount.lustre.0 Request processed in 446us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642407.507905:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788642407.507965:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443072:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788642407.508629:0:15079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788642407.508676:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788642407.508718:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642407.508804:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc55cf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788642407.508844:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107443200 00000100:00100000:2.0:1788642407.508849:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107443200 00000100:00100000:2.0:1788642407.508887:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788642407.508895:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+14:15079:x1875527107443200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788642407.509035:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+14:15079:x1875527107443200:12345-0@lo:502:mount.lustre.0 Request processed in 140us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642407.509048:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788642407.509074:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788642407.509375:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788642407.509421:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788642407.509456:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788642407.509544:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788642407.509584:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788642407.509631:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788642407.509676:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788642407.509927:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788642407.509960:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788642407.510011:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788642407.510049:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788642407.510184:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788642407.510220:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788642407.510273:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642407.510339:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0a2d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788642407.510379:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107443328 00000100:00100000:1.0:1788642407.510386:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107443328 00000100:00100000:1.0:1788642407.510423:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788642407.510432:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+14:15079:x1875527107443328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788642407.510761:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+14:15079:x1875527107443328:12345-0@lo:502:mount.lustre.0 Request processed in 329us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642407.510769:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788642407.510836:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788642407.510906:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788642407.510916:0:15079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788642407.512002:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788642407.512012:0:15093:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788642407.512019:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642407.512021:0:15093:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788642407.512027:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788642407.512056:0:15093:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ddcc6fdb380) 00000020:00000080:1.0:1788642407.512079:0:15093:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788642407.512086:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788642407.512333:0:15093:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ddde4e39000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788642407.512343:0:15093:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788642407.512351:0:15093:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4ae1ee156666e2cb 00010000:00010000:0.0:1788642407.516406:0:15093:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788642407.516984:0:15093:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788642407.519332:0:15093:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788642407.521046:0:15093:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788642407.521057:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642407.521064:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642407.521066:0:15093:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788642407.521070:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788642407.521073:0:15093:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788642407.521074:0:15093:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788642407.521076:0:15093:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788642407.521077:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788642407.521079:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642407.521081:0:15093:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788642407.521084:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642407.521087:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642407.521088:0:15093:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788642407.521571:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788642407.521573:0:15093:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788642407.521575:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642407.521578:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642407.521579:0:15093:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788642407.521582:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642407.521585:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642407.521586:0:15093:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788642407.521589:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788642407.521655:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642407.521658:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642407.521660:0:15093:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788642407.521663:0:15093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788642407.526058:0:15079:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788642407.526133:0:15079:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788642407.526155:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa600/0x4ae1ee156666e2b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e2bd expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642407.526170:0:15079:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddeffaa600/0x4ae1ee156666e2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e2bd expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788642407.526197:0:15079:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ddde4e39000 from 1 10000000:01000000:3.0:1788642407.526201:0:15079:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788642407.526241:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642407.526250:0:15079:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642407.526262:0:15079:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642407.526300:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788642407.526382:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642407.526428:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc55cf900 going to sleep for 11 seconds 00000100:00100000:0.0:1788642407.526789:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107443456 00000100:00100000:0.0:1788642407.526797:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107443456 00000100:00100000:0.0:1788642407.526892:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788642407.526903:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+14:15079:x1875527107443456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788642407.526917:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642407.526932:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfaa5de00/0x4ae1ee156666e2d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e2d2 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642407.526956:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfaa5de00/0x4ae1ee156666e2d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e2d2 expref: 15 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642407.526968:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfaa5de00/0x4ae1ee156666e2d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e2d2 expref: 15 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642407.526978:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfaa5de00, rc 0) 00000100:00100000:0.0:1788642407.527038:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+15:15079:x1875527107443456:12345-0@lo:101:mount.lustre.0 Request processed in 137us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642407.527046:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788642407.527163:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788642407.527181:0:15079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e2d9 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642407.527191:0:15079:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e2d9 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788642407.527922:0:15079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788642407.528275:0:15079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788642407.528857:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788642407.528905:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788642407.529638:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788642407.529650:0:15079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788642407.530659:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788642407.530795:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642407.530833:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc55cf900 going to sleep for 11 seconds 00000100:00100000:0.0:1788642407.530840:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107443584 00000100:00100000:0.0:1788642407.530849:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107443584 00000100:00100000:0.0:1788642407.530922:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788642407.530931:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+15:15079:x1875527107443584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788642407.531189:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+15:15079:x1875527107443584:12345-0@lo:501:mount.lustre.0 Request processed in 258us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642407.531198:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788642407.531220:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788642407.531259:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788642407.531296:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642407.531323:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc55cf900 going to sleep for 11 seconds 00000100:00100000:0.0:1788642407.531400:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107443712 00000100:00100000:0.0:1788642407.531405:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107443712 00000100:00100000:0.0:1788642407.531457:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788642407.531463:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+15:15079:x1875527107443712:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788642407.531608:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+15:15079:x1875527107443712:12345-0@lo:503:mount.lustre.0 Request processed in 144us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642407.531615:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788642407.531675:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443712:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788642407.532084:0:15079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788642407.532211:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788642407.532253:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642407.532273:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc8c5d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642407.533832:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107443840 00000100:00100000:0.0:1788642407.533844:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107443840 00000100:00100000:0.0:1788642407.533909:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788642407.533921:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+15:15079:x1875527107443840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788642407.534215:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+15:15079:x1875527107443840:12345-0@lo:502:mount.lustre.0 Request processed in 296us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642407.534222:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788642407.534801:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788642407.535120:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788642407.535177:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788642407.535228:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788642407.535265:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788642407.535299:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788642407.535360:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788642407.535396:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788642407.535429:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788642407.535471:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788642407.536376:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642407.536441:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc8c5d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642407.536544:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107443968 00000100:00100000:0.0:1788642407.536551:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107443968 00000100:00100000:0.0:1788642407.536622:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788642407.536631:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+15:15079:x1875527107443968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788642407.536883:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+15:15079:x1875527107443968:12345-0@lo:502:mount.lustre.0 Request processed in 252us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642407.536891:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788642407.536968:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107443968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788642407.537127:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788642407.537142:0:15079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788642407.538190:0:15097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788642407.538201:0:15097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642407.538203:0:15097:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788642407.538209:0:15097:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ddde4e39000 00000020:00000080:2.0:1788642407.538211:0:15097:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788642407.538218:0:15097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642407.538221:0:15097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642407.538222:0:15097:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788642407.538224:0:15097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788642407.538226:0:15097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642407.538227:0:15097:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788642407.538231:0:15097:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ddde4e39000 00000020:00000080:2.0:1788642407.538232:0:15097:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788642407.538280:0:15097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642407.538284:0:15097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642407.538285:0:15097:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788642407.538287:0:15097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788642407.538300:0:15097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642407.538302:0:15097:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788642407.538305:0:15097:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ddde4e39000 00000020:00000080:2.0:1788642407.538307:0:15097:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788642407.538340:0:15097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788642407.538344:0:15097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788642407.538346:0:15097:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788642407.538348:0:15097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788642407.541797:0:15079:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788642407.541842:0:15079:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788642407.541868:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e2d9 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642407.541880:0:15079:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e2d9 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788642407.541949:0:15079:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788642407.541951:0:15079:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ddde4e39000 10000000:01000000:2.0:1788642407.541955:0:15079:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ddde4e39000 10000000:01000000:2.0:1788642407.541958:0:15079:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788642407.541964:0:15079:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ddde4e39000 from 1 10000000:01000000:2.0:1788642407.541966:0:15079:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788642407.542001:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1a00/0x4ae1ee156666e2e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642407.542009:0:15079:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1a00/0x4ae1ee156666e2e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642407.542019:0:15079:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1a00/0x4ae1ee156666e2e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642407.542042:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa882a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107444096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788642407.542139:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642407.545357:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc9373780 going to sleep for 11 seconds 00000100:00100000:1.0:1788642407.547622:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107444096 00000100:00100000:1.0:1788642407.547636:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107444096 00000100:00100000:1.0:1788642407.547726:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788642407.547735:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+15:15079:x1875527107444096:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788642407.547751:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642407.547768:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfb3ba400/0x4ae1ee156666e2e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e2e0 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.547796:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfb3ba400/0x4ae1ee156666e2e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e2e0 expref: 16 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.547808:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfb3ba400/0x4ae1ee156666e2e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e2e0 expref: 16 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.547824:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3ba400, rc 0) 00000100:00100000:1.0:1788642407.547895:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15079:x1875527107444096:12345-0@lo:101:mount.lustre.0 Request processed in 161us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642407.547903:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788642407.547960:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa882a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107444096:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788642407.547980:0:15079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1a00/0x4ae1ee156666e2e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e2e7 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642407.547990:0:15079:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1a00/0x4ae1ee156666e2e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e2e7 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788642407.549785:0:15079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788642407.552433:0:15079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788642407.553848:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788642407.553920:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788642407.553950:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788642407.553992:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788642407.554025:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788642407.554071:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788642407.554141:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788642407.554171:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788642407.554213:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788642407.554242:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788642407.554268:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788642407.554321:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788642407.554354:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788642407.554385:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788642407.554448:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788642407.556286:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788642407.556376:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788642407.556456:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788642407.557651:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788642407.557792:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788642407.557856:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788642407.557892:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788642407.557924:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788642407.557971:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788642407.558005:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788642407.558033:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788642407.558121:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788642407.558161:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788642407.558251:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788642407.558259:0:15079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788642407.558376:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa882a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107444224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788642407.558444:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642407.559935:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc9373780 going to sleep for 11 seconds 00000100:00100000:1.0:1788642407.566636:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107444224 00000100:00100000:1.0:1788642407.566652:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107444224 00000100:00100000:1.0:1788642407.567644:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788642407.567660:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15079:x1875527107444224:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788642407.568081:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15079:x1875527107444224:12345-0@lo:501:mount.lustre.0 Request processed in 423us (9634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642407.568119:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788642407.568178:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa882a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107444224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788642407.568232:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107444352:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788642407.568278:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642407.568316:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5dc9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788642407.568600:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107444352 00000100:00100000:0.0:1788642407.568608:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107444352 00000100:00100000:0.0:1788642407.568650:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788642407.568659:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15079:x1875527107444352:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788642407.568886:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15079:x1875527107444352:12345-0@lo:503:mount.lustre.0 Request processed in 228us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642407.568894:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788642407.571642:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107444352:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788642407.572297:0:15079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788642407.572392:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6338700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107444480:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788642407.572457:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642407.572616:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107444480 00000100:00100000:1.0:1788642407.572622:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107444480 00000100:00100000:1.0:1788642407.572666:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788642407.572675:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15079:x1875527107444480:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788642407.573646:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15079:x1875527107444480:12345-0@lo:502:mount.lustre.0 Request processed in 967us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642407.573656:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788642407.574295:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc70386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642407.574322:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6338700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107444480:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788642407.574914:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788642407.574968:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788642407.574995:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788642407.575031:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788642407.575058:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788642407.575135:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788642407.575173:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788642407.575203:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788642407.575251:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788642407.575301:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788642407.575336:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788642407.575384:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788642407.575423:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788642407.575458:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788642407.575523:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788642407.575558:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788642407.575590:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788642407.575636:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788642407.575673:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788642407.577661:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788642407.577813:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788642407.577849:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788642407.577882:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788642407.577926:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788642407.577955:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788642407.578011:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788642407.578055:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788642407.578122:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788642407.578161:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788642407.578209:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788642407.578245:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788642407.578281:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788642407.578317:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788642407.578363:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788642407.578397:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788642407.578443:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788642407.579422:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788642407.579565:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788642407.579633:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788642407.579671:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788642407.579797:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107444608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788642407.580016:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642407.580166:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc55ed000 going to sleep for 11 seconds 00000100:00100000:1.0:1788642407.584640:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107444608 00000100:00100000:1.0:1788642407.584655:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107444608 00000100:00100000:1.0:1788642407.584879:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788642407.584890:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15079:x1875527107444608:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788642407.585289:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15079:x1875527107444608:12345-0@lo:502:mount.lustre.0 Request processed in 400us (5273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642407.585297:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788642407.585400:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107444608:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788642407.585520:0:15079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788642407.585537:0:15079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788642407.588995:0:15102:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788642407.589013:0:15102:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8dddc63419c0) 00000020:00000080:2.0:1788642407.589034:0:15102:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788642407.592411:0:15102:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ddde4e39000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788642407.592423:0:15102:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ddde4e39000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788642407.592426:0:15102:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ddde4e39000 3 00010000:00080000:2.0:1788642407.592559:0:15102:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dddfb5bf800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.149@tcp at head 00010000:00010000:3.0:1788642407.595329:0:15102:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788642407.595679:0:15102:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788642407.595786:0:15102:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788642407.595805:0:15102:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4ae1ee156666e2f5 00000100:00080000:3.0:1788642407.595815:0:15102:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788642407.595821:0:15102:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dddfb5bf800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:3.0:1788642407.595852:0:15102:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfb40c380 x1875527107444736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788642407.595886:0:15102:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788642407.596128:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1875527107444736:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788642407.596193:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788642407.596421:0:15102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788642407.596626:0:15079:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788642407.596654:0:15079:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788642407.596676:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1a00/0x4ae1ee156666e2e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e2e7 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642407.596791:0:15079:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1a00/0x4ae1ee156666e2e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e2e7 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788642407.596837:0:15079:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788642407.596839:0:15079:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788642407.596841:0:15079:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642407.596842:0:15079:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642407.596843:0:15079:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642407.596844:0:15079:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642407.596846:0:15079:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788642407.596847:0:15079:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642407.596849:0:15079:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788642407.596852:0:15079:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788642407.596855:0:15079:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788642407.596856:0:15079:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788642407.596858:0:15079:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642407.596859:0:15079:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642407.596860:0:15079:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642407.596861:0:15079:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642407.596862:0:15079:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788642407.596863:0:15079:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642407.596864:0:15079:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788642407.596884:0:15079:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788642407.596897:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107444864:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788642407.596941:0:15079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642407.596964:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc70d3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788642407.597039:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107444864 00000100:00100000:1.0:1788642407.597045:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107444864 00000100:00100000:1.0:1788642407.597120:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788642407.597129:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15079:x1875527107444864:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788642407.597152:0:14389:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788642407.597165:0:14389:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788642407.599018:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107444736 00000100:00100000:0.0:1788642407.599031:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107444736 00000100:00100000:0.0:1788642407.599070:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642407.599078:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1875527107444736:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788642407.599134:0:14397:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:0.0:1788642407.599171:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4ae1ee156666e2fc 00000004:00100000:0.0:1788642407.599186:0:14397:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788642407.599219:0:14397:0:(import.c:65:import_set_state_nolock()) ffff8dddc64ac800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788642407.599306:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875527107444736:12345-0@lo:38:llog_process_th.0 Request processed in 227us (3112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642407.599314:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788642407.599374:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dddfb40c380 x1875527107444736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788642417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642407.599389:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788642407.599398:0:3316:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788642407.599406:0:3316:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788642407.599411:0:3316:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788642407.599422:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddfb5bf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788642407.599428:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1875527107444736:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788642407.600609:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788642407.600615:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788642407.600618:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788642407.600620:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788642407.600670:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788642407.602078:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107444992:0@lo:400:kworker.0 00000100:00100000:2.0:1788642407.602174:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642407.604633:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107444992 00000100:00100000:1.0:1788642407.604646:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107444992 00000100:00100000:1.0:1788642407.604784:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788642407.604795:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107444992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642407.604890:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107444992:12345-0@lo:400:kworker.0 Request processed in 98us (2716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642407.604897:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788642407.609080:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dddfa882d80 x1875527107444992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642407.609132:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107444992:0@lo:400:kworker.0 20000000:01000000:1.0:1788642407.624057:0:14389:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788642407.624131:0:14389:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788642407.625031:0:14411:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788642407.625038:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788642407.625061:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642407.625078:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e269 expref: 16 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642407.625084:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642407.625170:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666e269 expref: 16 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642407.625185:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e270 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666e269 expref: 16 pid: 14390 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642407.625200:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6338700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1875527107445120:0@lo:104: 00000100:00100000:0.0:1788642407.625264:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642407.625424:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107445120 00000100:00100000:2.0:1788642407.625431:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107445120 00000100:00100000:2.0:1788642407.625485:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788642407.625494:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+3:14411:x1875527107445120:12345-0@lo:104: 00010000:00010000:2.0:1788642407.625506:0:14379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e270 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642407.625561:0:14379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788642407.625568:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+3:14411:x1875527107445120:12345-0@lo:104: Request processed in 75us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642407.625588:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788642407.625657:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642407.625664:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e270 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.625672:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1600 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:1.0:1788642407.625676:0:14383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666e270 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642407.625807:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc7038840 going to sleep for 11 seconds 00000100:00100000:0.0:1788642407.625832:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6338700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1875527107445120:0@lo:104: 00010000:00010000:1.0:1788642407.625850:0:14383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666e270 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642407.625850:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788642407.625858:0:14383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666e270 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642407.625864:0:14383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788642407.625895:0:14383:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e270 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.625902:0:14383:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788642407.625921:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e270 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.625929:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e1600/0x4ae1ee156666e269 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e270 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.625943:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642407.625945:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642407.625946:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642407.625958:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788642407.625968:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3318:1875527107445248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788642407.625999:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642407.626029:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107445248 00000100:00100000:1.0:1788642407.626033:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107445248 00010000:00010000:1.0:1788642407.626051:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e270 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e269 expref: 17 pid: 14390 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642407.626073:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788642407.626085:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:3318:x1875527107445248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788642407.626132:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642407.626141:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e270 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e269 expref: 17 pid: 14390 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626154:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666e269 expref: 17 pid: 14390 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626166:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e270 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666e269 expref: 17 pid: 14390 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626177:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626186:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788642407.626198:0:14382:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001795938s 00010000:00010000:1.0:1788642407.626202:0:14382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626209:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626216:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626223:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626228:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642407.626237:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626245:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626260:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626501:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642407.626540:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:3318:x1875527107445248:12345-0@lo:103:ldlm_bl.0 Request processed in 455us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642407.626547:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788642407.626570:0:14411:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626578:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642407.626585:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfaa5c600/0x4ae1ee156666e303 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642407.626660:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3318:1875527107445248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788642407.629598:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+15:15079:x1875527107444864:12345-0@lo:253:mount.lustre.0 Request processed in 32461us (32647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642407.629612:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788642407.629817:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15079:1875527107444864:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788642407.629834:0:15079:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788642407.629838:0:15079:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788642407.629840:0:15079:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788642407.629841:0:15079:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642407.629842:0:15079:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642407.629843:0:15079:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642407.629844:0:15079:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642407.629846:0:15079:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788642407.629848:0:15079:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642407.629849:0:15079:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788642407.629862:0:15079:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788642407.636302:0:15079:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788642407.636473:0:15079:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788642407.636638:0:15079:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788642407.637087:0:15079:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788642407.637340:0:15079:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788642407.637531:0:15079:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788642407.638560:0:15079:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788642407.674221:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788642407.683977:0:15079:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788642407.683987:0:15079:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788642407.684039:0:15079:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788642407.684145:0:15079:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.149@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788642407.684163:0:15079:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788642407.684194:0:15079:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788642408.698629:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788642408.827209:0:14393:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788642408.827216:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dddf7f24800 from 7 10000000:01000000:3.0:1788642408.827222:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788642408.827260:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642408.827278:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642408.827289:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642408.827316:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107445376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788642408.827381:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642408.827430:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788642408.827609:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107445376 00000100:00100000:2.0:1788642408.827616:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107445376 00000100:00100000:2.0:1788642408.827670:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788642408.827680:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+15:14393:x1875527107445376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642408.827691:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642408.827703:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e1000/0x4ae1ee156666e311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e30a expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642408.827738:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e1000/0x4ae1ee156666e311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e30a expref: 16 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642408.827748:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e1000/0x4ae1ee156666e311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e30a expref: 16 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642408.827756:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1000, rc 0) 00000100:00100000:2.0:1788642408.827789:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:14393:x1875527107445376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642408.827795:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788642408.827947:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107445376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788642408.827961:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e311 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642408.827970:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e311 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642408.828014:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107445504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788642408.828044:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642408.828074:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddeffc4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788642408.828414:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107445504 00000100:00100000:2.0:1788642408.828419:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107445504 00000100:00100000:2.0:1788642408.828453:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788642408.828460:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:14393:x1875527107445504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788642408.828474:0:14389:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788642408.828498:0:14389:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788642408.828502:0:14389:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788642408.828571:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:14393:x1875527107445504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642408.828583:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788642408.828746:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107445504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788642408.828801:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788642408.828808:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e311 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642408.828816:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e311 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642409.722724:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642410.746377:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642411.770238:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788642412.731396:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788642412.731405:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788642412.731408:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788642412.731412:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788642412.731489:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3318:1875527107445632:0@lo:400:kworker.0 00000100:00100000:3.0:1788642412.731559:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642412.731616:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107445760:0@lo:400:kworker.0 00000100:00100000:3.0:1788642412.731643:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642412.731661:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642412.731666:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107445888:0@lo:400:kworker.0 00000100:00100000:3.0:1788642412.731690:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642412.732015:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107445632 00000100:00100000:3.0:1788642412.732024:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107445632 00000100:00100000:3.0:1788642412.732084:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788642412.732094:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:3318:x1875527107445632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642412.732172:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:3318:x1875527107445632:12345-0@lo:400:kworker.0 Request processed in 80us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642412.732180:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788642412.732218:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3318:1875527107445632:0@lo:400:kworker.0 00000100:00100000:1.0:1788642412.732271:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107445760 00000100:00100000:1.0:1788642412.732287:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107445760 00000100:00100000:1.0:1788642412.732319:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107445888 00000100:00100000:1.0:1788642412.732321:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107445888 00000100:00100000:2.0:1788642412.732349:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788642412.732357:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788642412.732362:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107445760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788642412.732369:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107445888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642412.732688:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107445760:12345-0@lo:400:kworker.0 Request processed in 329us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642412.732697:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788642412.732707:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddfb40ed80 x1875527107445760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642412.732721:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107445760:0@lo:400:kworker.0 00000100:00100000:1.0:1788642412.734574:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107445888:12345-0@lo:400:kworker.0 Request processed in 2202us (2876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642412.734587:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788642412.734684:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddfb40c000 x1875527107445888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642412.734698:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107445888:0@lo:400:kworker.0 00000100:00080000:1.0:1788642412.735176:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788642412.794350:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788642413.438381:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788642413.819394:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788642413.994986:0:15448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788642414.843324:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642415.867061:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642416.827204:0:3316:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788642401/real 1788642401] req@ffff8dddfad1e680 x1875527107441152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788642416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642416.827244:0:3316:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dddfad1e680 x1875527107441152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788642416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642416.827254:0:3316:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788642401/real 1788642401] req@ffff8dddfad1df80 x1875527107441280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788642416 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642416.827264:0:3316:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dddfad1df80 x1875527107441280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788642416 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788642416.827282:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddc9ef3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788642416.827306:0:3316:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788642416.827310:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107441152:0@lo:8:kworker.0 00000100:00080000:0.0:1788642416.827317:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddc9efa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788642416.827322:0:3316:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788642416.827324:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107441280:0@lo:8:kworker.0 00000100:00080000:2.0:1788642416.827430:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788642416.827434:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788642416.827437:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dddc9ef3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788642416.827442:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1788642416.827448:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788642416.827454:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dddc9ef3000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788642416.827474:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfa881c00 x1875527107446144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788642416.827487:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788642416.827489:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788642416.827490:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dddc9efa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788642416.827493:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1788642416.827495:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788642416.827505:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dddc9efa000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788642416.827518:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfa881880 x1875527107446272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788642416.827589:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107446400:0@lo:400:kworker.0 00000100:00100000:0.0:1788642416.827660:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642416.827711:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788642416.827717:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3318:1875527107446016:0@lo:400:kworker.0 00000100:00100000:0.0:1788642416.827745:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642416.827783:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107446016 00000100:00100000:0.0:1788642416.827791:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107446016 00000100:00100000:0.0:1788642416.827852:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788642416.827860:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:3318:x1875527107446016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788642416.827902:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:3318:x1875527107446016:12345-0@lo:400:kworker.0 Request processed in 43us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642416.827917:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788642416.827948:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107446144:0@lo:8:kworker.0 00000100:00100000:0.0:1788642416.827971:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642416.827985:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107446272:0@lo:8:kworker.0 00000100:00100000:0.0:1788642416.828001:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642416.828042:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107446144 00000100:00100000:0.0:1788642416.828045:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107446144 00000100:00100000:0.0:1788642416.828057:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107446272 00000100:00100000:0.0:1788642416.828059:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107446272 00000100:00100000:0.0:1788642416.828068:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788642416.828073:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3316:x1875527107446144:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788642416.828093:0:15082:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1788642416.828143:0:15082:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4ae1ee156666e318 00002000:00100000:0.0:1788642416.828154:0:15082:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dddd0f47800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788642416.828158:0:15082:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788642416.828161:0:15082:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788642416.828479:0:15082:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788642416.828501:0:15082:0:(import.c:65:import_set_state_nolock()) ffff8dddd0f42000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788642416.828541:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1875527107446144:12345-0@lo:8:kworker.0 Request processed in 466us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642416.828548:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788642416.828562:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788642416.828566:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3316:x1875527107446272:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788642416.828576:0:15082:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788642416.828597:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3316:x1875527107446272:12345-0@lo:8:kworker.0 Request processed in 31us (595us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788642416.828609:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788642416.828639:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3318:1875527107446016:0@lo:400:kworker.0 00010000:00080000:0.0:1788642416.828664:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddfa881c00 x1875527107446144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788642436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788642416.828674:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788642416.828680:0:3316:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788642416.828687:0:3316:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788642416.828692:0:3316:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788642416.828694:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddc9ef3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788642416.828706:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788642416.828710:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107446144:0@lo:8:kworker.0 00000100:00080000:0.0:1788642416.828719:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddc9efa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788642416.828722:0:3316:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788642416.828725:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107446272:0@lo:8:kworker.0 00000004:00080000:0.0:1788642416.828760:0:14419:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788642416.828774:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6339500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14419:1875527107446784:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788642416.828796:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642416.828811:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc537c180 going to sleep for 11 seconds 00000004:00080000:0.0:1788642416.828822:0:14418:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788642416.829021:0:14418:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 504289921451ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788642416.829579:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107446784 00000100:00100000:0.0:1788642416.829586:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107446784 00000100:00100000:0.0:1788642416.829625:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642416.829632:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14419:x1875527107446784:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788642416.831187:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107446400 00000100:00100000:2.0:1788642416.831199:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107446400 00000100:00100000:2.0:1788642416.831258:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788642416.831267:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107446400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642416.831346:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107446400:12345-0@lo:400:kworker.0 Request processed in 81us (3687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642416.831353:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788642416.835225:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107446528:0@lo:400:kworker.0 00000100:00100000:3.0:1788642416.835306:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642416.835347:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642416.835355:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107446656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642416.835382:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642416.835423:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107446528 00000100:00100000:3.0:1788642416.835430:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107446528 00000100:00100000:3.0:1788642416.835482:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788642416.835491:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107446528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642416.835542:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107446528:12345-0@lo:400:kworker.0 Request processed in 52us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642416.835550:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788642416.835579:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107446656 00000100:00100000:3.0:1788642416.835583:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107446656 00000100:00100000:3.0:1788642416.835605:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788642416.835611:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1875527107446656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642416.835652:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642416.835687:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1875527107446656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642416.835693:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788642416.835730:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ddcc633ad80 x1875527107446656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642416.835764:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107446656:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788642416.835779:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddfa882680 x1875527107446528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642416.835789:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107446528:0@lo:400:kworker.0 00000100:00080000:2.0:1788642416.836805:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788642416.836814:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788642416.836853:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddfa880000 x1875527107446400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642416.836866:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107446400:0@lo:400:kworker.0 00002000:00080000:0.0:1788642416.848754:0:15082:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788642416.848775:0:15082:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788642416.848780:0:15082:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1788642416.869536:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.869551:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e31f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.869568:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.869573:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.869579:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e31f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.869598:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e31f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.869609:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e31f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.869618:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e31f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.869653:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642416.869667:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642416.869673:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e31f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.869681:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642416.869685:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e31f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.869701:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e31f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.869717:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e31f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.869726:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e31f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.869745:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.869747:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.869749:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788642416.870296:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.870302:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cad1418f/0x4ae1ee156666e326 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870312:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.870315:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.870319:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cad1418f/0x4ae1ee156666e326 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870329:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cad1418f/0x4ae1ee156666e326 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870336:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cad1418f/0x4ae1ee156666e326 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870350:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cad1418f/0x4ae1ee156666e326 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870365:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642416.870375:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642416.870379:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cad1418f/0x4ae1ee156666e326 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870386:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5da00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642416.870389:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cad1418f/0x4ae1ee156666e326 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870396:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cad1418f/0x4ae1ee156666e326 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870408:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cad1418f/0x4ae1ee156666e326 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870415:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cad1418f/0x4ae1ee156666e326 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870427:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.870429:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.870431:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788642416.870838:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.870851:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0012acd/0x4ae1ee156666e32d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870861:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.870864:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.870868:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0012acd/0x4ae1ee156666e32d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870877:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0012acd/0x4ae1ee156666e32d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870885:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0012acd/0x4ae1ee156666e32d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870892:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0012acd/0x4ae1ee156666e32d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870904:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642416.870912:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642416.870916:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0012acd/0x4ae1ee156666e32d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870923:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5dc00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642416.870926:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0012acd/0x4ae1ee156666e32d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870932:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0012acd/0x4ae1ee156666e32d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870950:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0012acd/0x4ae1ee156666e32d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870957:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0012acd/0x4ae1ee156666e32d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.870972:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.870974:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.870975:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788642416.871464:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.871470:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8a5fce2/0x4ae1ee156666e334 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.871479:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.871482:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.871487:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8a5fce2/0x4ae1ee156666e334 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.871496:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8a5fce2/0x4ae1ee156666e334 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.871504:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8a5fce2/0x4ae1ee156666e334 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.871512:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8a5fce2/0x4ae1ee156666e334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.871536:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642416.871544:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642416.871547:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8a5fce2/0x4ae1ee156666e334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.871554:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c800 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642416.871558:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8a5fce2/0x4ae1ee156666e334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.871567:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8a5fce2/0x4ae1ee156666e334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.871577:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8a5fce2/0x4ae1ee156666e334 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.871584:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8a5fce2/0x4ae1ee156666e334 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.871598:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.871600:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.871601:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788642416.871997:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.874980:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047c658a/0x4ae1ee156666e33b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.875017:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.875036:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.875043:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000047c658a/0x4ae1ee156666e33b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.875061:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000047c658a/0x4ae1ee156666e33b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.875072:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047c658a/0x4ae1ee156666e33b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.875081:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000047c658a/0x4ae1ee156666e33b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.875118:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642416.875134:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642416.875139:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000047c658a/0x4ae1ee156666e33b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.875147:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642416.875152:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000047c658a/0x4ae1ee156666e33b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.875162:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000047c658a/0x4ae1ee156666e33b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.875178:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000047c658a/0x4ae1ee156666e33b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.875196:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000047c658a/0x4ae1ee156666e33b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.875220:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.875222:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.875223:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788642416.875975:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.875984:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666e342 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.875995:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.875999:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.876015:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666e342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876027:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666e342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876035:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666e342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876043:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666e342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876060:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642416.876071:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642416.876081:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666e342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876088:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642416.876092:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666e342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876123:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666e342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876137:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666e342 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876144:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068463a10/0x4ae1ee156666e342 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876160:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.876161:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.876163:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788642416.876545:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.876551:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b59daf/0x4ae1ee156666e349 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876561:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.876564:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.876569:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092b59daf/0x4ae1ee156666e349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876590:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092b59daf/0x4ae1ee156666e349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876599:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b59daf/0x4ae1ee156666e349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876606:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092b59daf/0x4ae1ee156666e349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876620:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642416.876627:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642416.876631:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092b59daf/0x4ae1ee156666e349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876785:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642416.876789:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b59daf/0x4ae1ee156666e349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876868:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b59daf/0x4ae1ee156666e349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876881:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092b59daf/0x4ae1ee156666e349 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876889:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092b59daf/0x4ae1ee156666e349 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.876909:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.876911:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.876913:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788642416.877305:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.877312:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666e350 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.877321:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.877325:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.877330:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666e350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.877340:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666e350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.877348:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666e350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.877356:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666e350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.877371:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642416.877378:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642416.877382:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666e350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.877400:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5cc00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642416.877404:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666e350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.877412:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666e350 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.877423:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666e350 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.877429:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e314aac/0x4ae1ee156666e350 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.877442:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.877444:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.877445:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788642416.878072:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.878078:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbe9801/0x4ae1ee156666e357 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.878087:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.878090:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.878094:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbe9801/0x4ae1ee156666e357 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.883182:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddbe9801/0x4ae1ee156666e357 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.883206:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddbe9801/0x4ae1ee156666e357 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.883215:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddbe9801/0x4ae1ee156666e357 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.883238:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788642416.884158:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642416.884167:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddbe9801/0x4ae1ee156666e357 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.884177:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d400 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642416.884181:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbe9801/0x4ae1ee156666e357 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.884189:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddbe9801/0x4ae1ee156666e357 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.884209:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddbe9801/0x4ae1ee156666e357 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.884216:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddbe9801/0x4ae1ee156666e357 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788642416.897818:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.897833:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e35e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.897849:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.897854:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.897860:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e35e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.897876:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e35e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.897886:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e35e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.897894:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e35e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.897934:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788642416.898566:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.898574:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7195ddb/0x4ae1ee156666e365 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.898584:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.898587:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.898592:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7195ddb/0x4ae1ee156666e365 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.898602:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7195ddb/0x4ae1ee156666e365 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.898611:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7195ddb/0x4ae1ee156666e365 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.898619:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7195ddb/0x4ae1ee156666e365 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.898629:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788642416.899080:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.899087:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054f53ddf/0x4ae1ee156666e36c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.899095:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.899131:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.899136:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054f53ddf/0x4ae1ee156666e36c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.899147:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054f53ddf/0x4ae1ee156666e36c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.899155:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054f53ddf/0x4ae1ee156666e36c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.899163:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054f53ddf/0x4ae1ee156666e36c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.899172:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788642416.899565:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.899571:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026c1a7e3/0x4ae1ee156666e373 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.899579:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.899582:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.899586:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026c1a7e3/0x4ae1ee156666e373 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.899596:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026c1a7e3/0x4ae1ee156666e373 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.899605:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026c1a7e3/0x4ae1ee156666e373 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.899618:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026c1a7e3/0x4ae1ee156666e373 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.899627:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788642416.900045:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.900051:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e37a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642416.900378:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788642416.901590:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788642416.901601:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7195ddb/0x4ae1ee156666e365 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901612:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5ca00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642416.901616:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7195ddb/0x4ae1ee156666e365 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901626:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7195ddb/0x4ae1ee156666e365 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901655:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7195ddb/0x4ae1ee156666e365 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901663:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7195ddb/0x4ae1ee156666e365 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901682:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788642416.901686:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054f53ddf/0x4ae1ee156666e36c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901693:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d800 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642416.901696:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054f53ddf/0x4ae1ee156666e36c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901721:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054f53ddf/0x4ae1ee156666e36c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901731:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054f53ddf/0x4ae1ee156666e36c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901738:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054f53ddf/0x4ae1ee156666e36c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901750:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642416.901753:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026c1a7e3/0x4ae1ee156666e373 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901759:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5d000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642416.901762:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026c1a7e3/0x4ae1ee156666e373 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901768:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026c1a7e3/0x4ae1ee156666e373 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901777:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026c1a7e3/0x4ae1ee156666e373 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901783:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026c1a7e3/0x4ae1ee156666e373 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.901804:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.901806:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.901808:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.904340:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.904772:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.904776:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.904785:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e37a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.904801:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e37a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.904813:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e37a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.904821:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e37a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.904949:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642416.905487:0:15570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642416.905494:0:15570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e37a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.905508:0:15570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6120c00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642416.905513:0:15570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e37a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.905522:0:15570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e37a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.905540:0:15570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e37a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.905547:0:15570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e37a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.905573:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e35e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.905581:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfaa5c600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642416.905584:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e35e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.905591:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e35e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.905600:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e35e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.905618:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000747e7133/0x4ae1ee156666e35e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.905633:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.910306:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.911970:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.915355:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788642416.915750:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.915761:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0a93127/0x4ae1ee156666e381 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.915777:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.915782:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.915788:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a93127/0x4ae1ee156666e381 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.915803:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0a93127/0x4ae1ee156666e381 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.915812:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0a93127/0x4ae1ee156666e381 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.915820:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a93127/0x4ae1ee156666e381 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.916030:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788642416.916575:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.916586:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8a7e800/0x4ae1ee156666e388 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.916597:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.916601:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.916605:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8a7e800/0x4ae1ee156666e388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.916615:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8a7e800/0x4ae1ee156666e388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.916625:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8a7e800/0x4ae1ee156666e388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.916640:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8a7e800/0x4ae1ee156666e388 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788642416.925552:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788642416.926423:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788642416.926436:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0a93127/0x4ae1ee156666e381 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.926450:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642416.926456:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0a93127/0x4ae1ee156666e381 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.926467:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0a93127/0x4ae1ee156666e381 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.926518:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0a93127/0x4ae1ee156666e381 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.926526:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0a93127/0x4ae1ee156666e381 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.926551:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788642416.926555:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8a7e800/0x4ae1ee156666e388 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.926561:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6120400 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642416.926564:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8a7e800/0x4ae1ee156666e388 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.926571:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8a7e800/0x4ae1ee156666e388 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.926579:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8a7e800/0x4ae1ee156666e388 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.926585:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642416.926587:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642416.926589:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.926667:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.926670:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.926672:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642416.926784:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788642416.926792:0:15082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8a7e800/0x4ae1ee156666e388 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788642416.927540:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642416.927547:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e38f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.927559:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788642416.927563:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642416.927574:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e38f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.927586:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e38f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.927594:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e38f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.927601:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e38f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642416.927619:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788642416.927980:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788642416.927987:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e38f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.928020:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6120c00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642416.928024:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e38f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.928033:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e38f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.928048:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e38f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.928056:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a926890b/0x4ae1ee156666e38f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.928072:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642416.928074:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642416.928076:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.928159:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788642416.933897:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788642416.933908:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660825dc/0x4ae1ee156666e396 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.933925:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788642416.933930:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642416.933936:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000660825dc/0x4ae1ee156666e396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.933951:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000660825dc/0x4ae1ee156666e396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.933961:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660825dc/0x4ae1ee156666e396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.933969:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000660825dc/0x4ae1ee156666e396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934015:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788642416.934468:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788642416.934475:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e39d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934485:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788642416.934489:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642416.934492:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e39d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934501:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e39d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934509:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e39d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934515:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e39d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934538:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788642416.934890:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788642416.934896:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934903:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788642416.934911:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642416.934915:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934923:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934930:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934936:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934950:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788642416.934966:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788642416.934971:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000660825dc/0x4ae1ee156666e396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934978:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642416.934982:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000660825dc/0x4ae1ee156666e396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.934991:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000660825dc/0x4ae1ee156666e396 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935019:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000660825dc/0x4ae1ee156666e396 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935036:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000660825dc/0x4ae1ee156666e396 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935059:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788642416.935062:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e39d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935068:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bbe00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642416.935071:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e39d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935078:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e39d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935086:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e39d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935092:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e39d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935135:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642416.935138:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935143:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642416.935151:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935158:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935168:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935175:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935189:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.935191:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.935192:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788642416.935592:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788642416.935598:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935607:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788642416.935611:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642416.935615:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935625:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935634:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935648:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935663:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788642416.935671:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642416.935675:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935683:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642416.935686:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935695:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935707:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935714:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.935728:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.935730:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.935732:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642416.936771:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788642416.939363:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788642416.939386:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f02b983/0x4ae1ee156666e3b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.939403:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788642416.939407:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642416.939414:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f02b983/0x4ae1ee156666e3b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.939429:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f02b983/0x4ae1ee156666e3b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.939441:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f02b983/0x4ae1ee156666e3b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.939449:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f02b983/0x4ae1ee156666e3b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.939469:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788642416.939482:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642416.939488:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f02b983/0x4ae1ee156666e3b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.939497:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bb200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642416.939502:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f02b983/0x4ae1ee156666e3b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.939513:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f02b983/0x4ae1ee156666e3b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.939536:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f02b983/0x4ae1ee156666e3b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.939545:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f02b983/0x4ae1ee156666e3b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.939572:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.939574:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.939577:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642416.940164:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788642416.941149:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788642416.941158:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000933212f2/0x4ae1ee156666e3b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.941170:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788642416.941175:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642416.941181:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000933212f2/0x4ae1ee156666e3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.941193:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000933212f2/0x4ae1ee156666e3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.941203:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000933212f2/0x4ae1ee156666e3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.941211:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000933212f2/0x4ae1ee156666e3b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.941236:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788642416.941598:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788642416.941603:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000009169de/0x4ae1ee156666e3c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.941611:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788642416.941614:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642416.941618:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000009169de/0x4ae1ee156666e3c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.941626:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000009169de/0x4ae1ee156666e3c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.941834:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788642416.941841:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000933212f2/0x4ae1ee156666e3b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.941848:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba800 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642416.941852:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000933212f2/0x4ae1ee156666e3b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.941871:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000933212f2/0x4ae1ee156666e3b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.941885:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000933212f2/0x4ae1ee156666e3b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.941892:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000933212f2/0x4ae1ee156666e3b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.941912:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642416.941913:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642416.941914:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.941942:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000009169de/0x4ae1ee156666e3c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.941952:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000009169de/0x4ae1ee156666e3c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.942067:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788642416.942455:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788642416.942461:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f30ff6b8/0x4ae1ee156666e3c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.942470:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788642416.942479:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642416.942484:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f30ff6b8/0x4ae1ee156666e3c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.942494:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f30ff6b8/0x4ae1ee156666e3c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.942501:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f30ff6b8/0x4ae1ee156666e3c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.942508:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f30ff6b8/0x4ae1ee156666e3c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.943533:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788642416.943546:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000009169de/0x4ae1ee156666e3c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.943559:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bac00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642416.943563:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000009169de/0x4ae1ee156666e3c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.943573:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000009169de/0x4ae1ee156666e3c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.943589:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000009169de/0x4ae1ee156666e3c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.943611:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000009169de/0x4ae1ee156666e3c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.943646:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788642416.943650:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f30ff6b8/0x4ae1ee156666e3c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.943656:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bb600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642416.943659:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f30ff6b8/0x4ae1ee156666e3c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.943666:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f30ff6b8/0x4ae1ee156666e3c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.943676:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f30ff6b8/0x4ae1ee156666e3c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.943682:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642416.943684:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642416.943685:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.943898:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788642416.943905:0:15082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f30ff6b8/0x4ae1ee156666e3c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788642416.945071:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788642416.945079:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.945093:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788642416.945615:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642416.945623:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.945709:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.945735:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.945744:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642416.950608:0:15570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642416.950625:0:15570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642416.950652:0:15570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:3.0:1788642416.950658:0:15570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642416.950670:0:15570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642416.950691:0:15570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642416.950702:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642416.950704:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642416.950706:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.951758:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788642416.951770:0:15082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000082fcdd2/0x4ae1ee156666e3ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788642416.952445:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788642416.952454:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e3d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.952468:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788642416.952473:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642416.952479:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e3d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.952492:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e3d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.952502:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e3d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.952520:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e3d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.953850:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788642416.953860:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e3d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.953871:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bbe00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642416.953887:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e3d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.953897:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e3d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.953915:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e3d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.953923:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642416.953925:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642416.953926:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642416.954056:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788642416.954063:0:15082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005a07ef4/0x4ae1ee156666e3d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642416.954226:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788642416.955959:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788642416.955971:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.955986:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788642416.955990:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642416.955997:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.956023:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.956032:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.956039:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642416.956156:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788642416.956378:0:15082:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1788642416.956473:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14419:x1875527107446784:12345-0@lo:5:osp-pre-0-0.0 Request processed in 126837us (127671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642416.956488:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642416.956601:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6339500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14419:1875527107446784:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788642416.956618:0:14419:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788642416.956742:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6339500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14419:1875527107446912:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788642416.956776:0:14419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642416.956823:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc995acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642416.956902:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107446912 00000100:00100000:2.0:1788642416.956910:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107446912 00000100:00100000:2.0:1788642416.956959:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788642416.956968:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14419:x1875527107446912:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788642416.957019:0:15080:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1788642416.960174:0:15570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788642416.960187:0:15570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642416.960209:0:15570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:3.0:1788642416.960214:0:15570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642416.960226:0:15570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642416.960250:0:15570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642416.960257:0:15570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1ae9a29/0x4ae1ee156666e3dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642416.960290:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642416.960292:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642416.960294:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642416.962755:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14419:x1875527107446912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5780us (5970us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788642416.962769:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788642416.962906:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6339500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14419:1875527107446912:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788642416.962924:0:14419:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1788642417.919752:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788642417.979155:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788642417.979191:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1788642418.939323:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642419.962224:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642420.987284:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642421.946815:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107447040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642421.946888:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642421.947045:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107447040 00000100:00100000:3.0:1788642421.947052:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107447040 00000100:00100000:3.0:1788642421.947131:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788642421.947140:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107447040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642421.947170:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642421.947210:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107447040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (322us total) trans 0 rc 0/0 00000100:00080000:1.0:1788642421.948370:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788642421.948375:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788642421.948379:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dddc9efa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788642421.948385:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:1.0:1788642421.948389:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788642421.948395:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dddc9efa000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:1.0:1788642421.948414:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfad1f100 x1875527107447296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788642421.948485:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107447296:0@lo:8:kworker.0 00000100:00100000:1.0:1788642421.948542:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642421.948576:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107447424:0@lo:400:kworker.0 00000100:00100000:1.0:1788642421.948613:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642421.948630:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642421.948636:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107447552:0@lo:400:kworker.0 00000100:00100000:1.0:1788642421.948654:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642421.948692:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107447296 00000100:00100000:1.0:1788642421.948697:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107447296 00000100:00100000:1.0:1788642421.948727:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788642421.948733:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3316:x1875527107447296:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788642421.948748:0:15082:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788642421.948860:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788642421.948898:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642421.948930:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788642421.948950:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107447040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642421.948974:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788642421.948980:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3317:1875527107447168:0@lo:400:kworker.0 00000100:00100000:3.0:1788642421.949010:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642421.949290:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107447168 00000100:00100000:3.0:1788642421.949294:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107447168 00000100:00100000:3.0:1788642421.949324:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788642421.949331:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:3317:x1875527107447168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642421.949372:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:3317:x1875527107447168:12345-0@lo:400:kworker.0 Request processed in 41us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642421.949379:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788642421.949580:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3317:1875527107447168:0@lo:400:kworker.0 00000100:00100000:0.0:1788642421.951048:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107447424 00000100:00100000:0.0:1788642421.951058:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107447424 00000100:00100000:0.0:1788642421.951178:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107447552 00000100:00100000:0.0:1788642421.951182:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107447552 00000100:00100000:3.0:1788642421.956629:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788642421.956706:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642421.957385:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107447424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642421.957484:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107447424:12345-0@lo:400:kworker.0 Request processed in 842us (8869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642421.957493:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788642421.957518:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788642421.958682:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107447552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642421.958737:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875527107447552:12345-0@lo:400:kworker.0 Request processed in 66us (10081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642421.958832:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788642421.959701:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddfad1d880 x1875527107447552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642421.959718:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1875527107447552:0@lo:400:kworker.0 00010000:00080000:3.0:1788642421.959733:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddfad1c000 x1875527107447424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788642421.959743:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107447424:0@lo:400:kworker.0 00000020:01000004:2.0:1788642421.963592:0:15801:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788642421.963597:0:15801:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788642421.963739:0:15801:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dddefa29000 00000020:01000004:2.0:1788642421.963824:0:15801:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788642421.963837:0:15801:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788642421.963855:0:15801:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8dddc6344d40) 00000020:00000080:2.0:1788642421.963982:0:15801:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788642421.988462:0:15801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788642421.988825:0:15801:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788642421.993469:0:15801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788642421.997139:0:15801:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788642421.997411:0:15801:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788642421.997775:0:15801:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 501: rc = 0 00100000:10000000:2.0:1788642421.997894:0:15801:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 501: rc = 0 00100000:10000000:2.0:1788642421.998566:0:15801:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 501: rc = 0 00000100:00100000:1.0:1788642421.999075:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3316:x1875527107447296:12345-0@lo:8:kworker.0 Request processed in 50337us (50528us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788642421.999087:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788642421.999174:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddc9efa000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788642421.999179:0:3316:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788642421.999184:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107447296:0@lo:8:kworker.0 00100000:10000000:2.0:1788642422.000557:0:15801:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:2.0:1788642422.000932:0:15801:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:2.0:1788642422.001323:0:15801:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 644: rc = 0 00100000:10000000:2.0:1788642422.001567:0:15801:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 644: rc = 0 00100000:10000000:2.0:1788642422.002094:0:15801:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:2.0:1788642422.002417:0:15801:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 644: rc = 0 00000020:00000080:2.0:1788642422.004383:0:15801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788642422.004398:0:15801:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788642422.004415:0:15801:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4ae1ee156666e3ea 00000020:01000004:2.0:1788642422.004423:0:15801:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788642422.004446:0:15801:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.149@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788642422.004450:0:15801:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.149@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788642422.004456:0:15801:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788642422.004479:0:15801:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788642422.004483:0:15801:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.149@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:1.0:1788642422.016067:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788642422.036267:0:15801:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.149@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788642422.036310:0:15801:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.149@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788642422.036315:0:15801:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788642422.036317:0:15801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788642422.036319:0:15801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642422.036320:0:15801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642422.036321:0:15801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642422.036323:0:15801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642422.036324:0:15801:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788642422.036325:0:15801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642422.036326:0:15801:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788642422.036329:0:15801:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788642422.036331:0:15801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788642422.036333:0:15801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788642422.036334:0:15801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642422.036335:0:15801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642422.036336:0:15801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642422.036337:0:15801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642422.036338:0:15801:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788642422.036339:0:15801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642422.036340:0:15801:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788642422.036366:0:15801:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788642422.036386:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107447680:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788642422.036453:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642422.036573:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7387cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642422.036687:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107447680 00000100:00100000:0.0:1788642422.036694:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107447680 00000100:00100000:0.0:1788642422.037266:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788642422.037278:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15801:x1875527107447680:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788642422.037309:0:14389:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788642422.037311:0:14389:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788642422.037315:0:14389:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788642422.047201:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15801:x1875527107447680:12345-0@lo:253:mount.lustre.0 Request processed in 9916us (10737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642422.047218:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788642422.047421:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107447680:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788642422.047438:0:15801:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788642422.047441:0:15801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788642422.047443:0:15801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788642422.047444:0:15801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788642422.047445:0:15801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788642422.047447:0:15801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788642422.047448:0:15801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788642422.047449:0:15801:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788642422.047451:0:15801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788642422.047452:0:15801:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788642422.047548:0:15801:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dddefa29000 from lustre-OST0001 10000000:01000000:0.0:1788642422.047573:0:15801:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788642422.047576:0:15801:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788642422.047584:0:15801:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dddc4e019c0 local copy 00010000:00010000:0.0:1788642422.047658:0:15801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e197 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642422.048027:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6338380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107447808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788642422.048070:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642422.048165:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788642422.048210:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107447808 00000100:00100000:3.0:1788642422.048216:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107447808 00000100:00100000:3.0:1788642422.048292:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788642422.048302:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15801:x1875527107447808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788642422.048532:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15801:x1875527107447808:12345-0@lo:501:mount.lustre.0 Request processed in 232us (461us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788642422.048539:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788642422.048620:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6338380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107447808:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788642422.048634:0:15801:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.149@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788642422.048796:0:15801:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.149@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788642422.048803:0:15801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e197 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.048811:0:15801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddeffaba00/0x4ae1ee156666e190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e197 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642422.048831:0:15801:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dddefa29000 10000000:01000000:1.0:1788642422.048836:0:15801:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788642422.048841:0:15801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788642422.048843:0:15801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788642422.048847:0:15801:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788642422.048850:0:15801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788642422.048886:0:15801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e3f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.048905:0:15801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e3f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.048914:0:15801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e3f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642422.048928:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107447936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788642422.048968:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642422.049263:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642422.049349:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107447936 00000100:00100000:0.0:1788642422.049353:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107447936 00000100:00100000:0.0:1788642422.049375:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788642422.049381:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:15801:x1875527107447936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788642422.049389:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642422.049401:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6120c00/0x4ae1ee156666e3f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e3f1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642422.049421:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6120c00/0x4ae1ee156666e3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e3f1 expref: 17 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642422.049432:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6120c00/0x4ae1ee156666e3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e3f1 expref: 17 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642422.049452:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6120c00, rc 0) 00000100:00100000:0.0:1788642422.049487:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:15801:x1875527107447936:12345-0@lo:101:mount.lustre.0 Request processed in 106us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642422.049493:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788642422.049565:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107447936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788642422.049578:0:15801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e3f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e3f8 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.049597:0:15801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e3f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e3f8 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788642422.050191:0:15801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788642422.050944:0:15801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788642422.051224:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788642422.051285:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788642422.051319:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788642422.051369:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788642422.051405:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788642422.051438:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788642422.051502:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788642422.051510:0:15801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788642422.051582:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788642422.051633:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642422.051659:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642422.052323:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107448064 00000100:00100000:0.0:1788642422.052333:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107448064 00000100:00100000:0.0:1788642422.052370:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788642422.052379:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:15801:x1875527107448064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788642422.052761:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:15801:x1875527107448064:12345-0@lo:501:mount.lustre.0 Request processed in 382us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642422.052769:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788642422.053060:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788642422.053115:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448192:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788642422.053159:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642422.053182:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642422.053288:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107448192 00000100:00100000:0.0:1788642422.053293:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107448192 00000100:00100000:0.0:1788642422.053314:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788642422.053320:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:15801:x1875527107448192:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788642422.053623:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:15801:x1875527107448192:12345-0@lo:503:mount.lustre.0 Request processed in 302us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642422.053631:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788642422.054496:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448192:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788642422.055404:0:15801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788642422.055486:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788642422.055560:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642422.055739:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642422.055967:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107448320 00000100:00100000:0.0:1788642422.055974:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107448320 00000100:00100000:0.0:1788642422.056013:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788642422.056022:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:15801:x1875527107448320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788642422.056296:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:15801:x1875527107448320:12345-0@lo:502:mount.lustre.0 Request processed in 274us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642422.056303:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788642422.056491:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448320:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788642422.061467:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788642422.061561:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788642422.061667:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788642422.061725:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788642422.062085:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788642422.062197:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788642422.062252:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788642422.062315:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788642422.062358:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788642422.062408:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788642422.062485:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642422.062579:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc60e5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642422.062683:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107448448 00000100:00100000:0.0:1788642422.062691:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107448448 00000100:00100000:0.0:1788642422.062858:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788642422.062877:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:15801:x1875527107448448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788642422.063118:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:15801:x1875527107448448:12345-0@lo:502:mount.lustre.0 Request processed in 228us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642422.063127:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788642422.063301:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448448:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788642422.063372:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788642422.063382:0:15801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788642422.067260:0:15802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788642422.067272:0:15802:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788642422.067279:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788642422.067281:0:15802:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788642422.067291:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788642422.067308:0:15802:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8dddfd7d99c0) 00000020:00000080:3.0:1788642422.067334:0:15802:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788642422.067341:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788642422.067401:0:15802:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dddefa29000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788642422.067409:0:15802:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788642422.067415:0:15802:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4ae1ee156666e406 00010000:00010000:1.0:1788642422.082814:0:15802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788642422.083496:0:15802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788642422.093390:0:15802:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788642422.096254:0:15802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788642422.096268:0:15802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642422.096274:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642422.096276:0:15802:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788642422.096280:0:15802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788642422.096284:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642422.096285:0:15802:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788642422.096288:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788642422.096290:0:15802:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788642422.096292:0:15802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642422.096294:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642422.096296:0:15802:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788642422.096298:0:15802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788642422.096300:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642422.096301:0:15802:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788642422.096304:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788642422.096363:0:15802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788642422.096365:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788642422.096366:0:15802:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788642422.096369:0:15802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788642422.097687:0:15801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788642422.097720:0:15801:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788642422.097734:0:15801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e3f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e3f8 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642422.097758:0:15801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbc00/0x4ae1ee156666e3f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e3f8 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788642422.097767:0:15801:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddefa29000 from 1 10000000:01000000:2.0:1788642422.097770:0:15801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788642422.097806:0:15801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642422.097814:0:15801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642422.097824:0:15801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642422.097846:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448576:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788642422.097916:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642422.097946:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5f88e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788642422.098287:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107448576 00000100:00100000:3.0:1788642422.098296:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107448576 00000100:00100000:3.0:1788642422.098351:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788642422.098360:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:15801:x1875527107448576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788642422.098373:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642422.098386:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddeffaac00/0x4ae1ee156666e414 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e40d expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642422.098410:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddeffaac00/0x4ae1ee156666e414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e40d expref: 18 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642422.098422:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddeffaac00/0x4ae1ee156666e414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e40d expref: 18 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642422.098430:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaac00, rc 0) 00000100:00100000:3.0:1788642422.098470:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:15801:x1875527107448576:12345-0@lo:101:mount.lustre.0 Request processed in 112us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642422.098477:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788642422.099892:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448576:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788642422.099917:0:15801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e414 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642422.099929:0:15801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e414 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788642422.100432:0:15801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788642422.100808:0:15801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788642422.101039:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788642422.101082:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788642422.101170:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788642422.101177:0:15801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788642422.101246:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788642422.101306:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642422.101348:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5f88e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642422.103015:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107448704 00000100:00100000:1.0:1788642422.103026:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107448704 00000100:00100000:1.0:1788642422.103086:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788642422.103113:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:15801:x1875527107448704:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788642422.103414:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:15801:x1875527107448704:12345-0@lo:501:mount.lustre.0 Request processed in 317us (2105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642422.103423:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788642422.105842:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788642422.106017:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448832:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788642422.106090:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642422.106192:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5f88e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788642422.108031:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107448832 00000100:00100000:0.0:1788642422.108044:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107448832 00000100:00100000:0.0:1788642422.108126:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788642422.108137:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd7ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:15801:x1875527107448832:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788642422.108551:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd7ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:15801:x1875527107448832:12345-0@lo:503:mount.lustre.0 Request processed in 415us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642422.108559:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788642422.114271:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448832:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788642422.115483:0:15801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788642422.115573:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788642422.115668:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642422.117162:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc8076e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642422.121031:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107448960 00000100:00100000:1.0:1788642422.121048:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107448960 00000100:00100000:1.0:1788642422.121459:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788642422.121482:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd7ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:15801:x1875527107448960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788642422.122069:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd7ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:15801:x1875527107448960:12345-0@lo:502:mount.lustre.0 Request processed in 588us (6399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642422.122079:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788642422.122217:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107448960:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788642422.122498:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788642422.122556:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788642422.122619:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788642422.122658:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788642422.122686:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788642422.122743:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788642422.122783:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788642422.122809:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788642422.122845:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa882300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788642422.122908:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642422.133478:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5f88e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788642422.138662:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107449088 00000100:00100000:3.0:1788642422.138679:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107449088 00000100:00100000:3.0:1788642422.139415:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788642422.139430:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfd7ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:15801:x1875527107449088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788642422.140203:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfd7ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:15801:x1875527107449088:12345-0@lo:502:mount.lustre.0 Request processed in 775us (17292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642422.140224:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788642422.140405:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa882300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788642422.140563:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788642422.140579:0:15801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788642422.149740:0:15806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642422.149763:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642422.149766:0:15806:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788642422.149774:0:15806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dddefa29000 00000020:00000080:0.0:1788642422.149777:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788642422.149784:0:15806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642422.149787:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642422.149788:0:15806:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788642422.149791:0:15806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642422.149794:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642422.149795:0:15806:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788642422.149798:0:15806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dddefa29000 00000020:00000080:0.0:1788642422.149801:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788642422.152876:0:15806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642422.152891:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642422.152893:0:15806:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788642422.152904:0:15806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788642422.152909:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642422.152911:0:15806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788642422.152916:0:15806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dddefa29000 00000020:00000080:0.0:1788642422.152919:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788642422.153042:0:15806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788642422.153046:0:15806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788642422.153048:0:15806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788642422.153051:0:15806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788642422.156700:0:15801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788642422.156766:0:15801:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788642422.173146:0:15801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e414 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642422.173165:0:15801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e414 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642422.173252:0:15801:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788642422.173255:0:15801:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dddefa29000 10000000:01000000:0.0:1788642422.173259:0:15801:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dddefa29000 10000000:01000000:0.0:1788642422.173263:0:15801:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788642422.173269:0:15801:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dddefa29000 from 1 10000000:01000000:0.0:1788642422.173273:0:15801:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788642422.173311:0:15801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666e41b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642422.173319:0:15801:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666e41b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642422.173330:0:15801:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666e41b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642422.173369:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788642422.173439:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642422.173487:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788642422.179661:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107449216 00000100:00100000:1.0:1788642422.179675:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107449216 00000100:00100000:1.0:1788642422.179740:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788642422.179755:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddce58cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:15801:x1875527107449216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788642422.179771:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642422.179787:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e41b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.179815:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e41b expref: 19 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.179827:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfb3bae00/0x4ae1ee156666e422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e41b expref: 19 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.179837:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3bae00, rc 0) 00000100:00100000:1.0:1788642422.179911:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddce58cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:15801:x1875527107449216:12345-0@lo:101:mount.lustre.0 Request processed in 157us (6472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642422.179919:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788642422.181255:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788642422.181280:0:15801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666e41b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e422 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642422.181291:0:15801:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666e41b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e422 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788642422.182474:0:15801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788642422.183438:0:15801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788642422.183702:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788642422.183877:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788642422.183921:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788642422.184012:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788642422.184055:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788642422.184277:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788642422.184318:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788642422.184352:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788642422.184397:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788642422.184431:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788642422.184464:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788642422.184523:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788642422.184564:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788642422.184596:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788642422.184644:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788642422.184681:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788642422.184718:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788642422.184913:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788642422.184967:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788642422.185008:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788642422.185077:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788642422.185190:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788642422.185318:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788642422.185369:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788642422.185407:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788642422.185442:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788642422.185492:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788642422.185528:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788642422.185567:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788642422.185622:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788642422.185660:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788642422.185693:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788642422.185723:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788642422.186037:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788642422.186085:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788642422.186399:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788642422.186469:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788642422.186589:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788642422.186598:0:15801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788642422.186693:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788642422.186971:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642422.187049:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788642422.187089:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107449344 00000100:00100000:3.0:1788642422.187160:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107449344 00000100:00100000:3.0:1788642422.187235:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788642422.187245:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:15801:x1875527107449344:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788642422.191399:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:15801:x1875527107449344:12345-0@lo:501:mount.lustre.0 Request processed in 4145us (4417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642422.191416:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788642422.194022:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788642422.194089:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788642422.194190:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642422.194240:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788642422.199573:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107449472 00000100:00100000:2.0:1788642422.199587:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107449472 00000100:00100000:2.0:1788642422.199777:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788642422.199789:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:15801:x1875527107449472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788642422.200197:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:15801:x1875527107449472:12345-0@lo:503:mount.lustre.0 Request processed in 410us (6007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642422.200205:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788642422.200695:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449472:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788642422.204256:0:15801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788642422.204352:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788642422.204448:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642422.204501:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc12ed180 going to sleep for 11 seconds 00000100:00100000:2.0:1788642422.204512:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107449600 00000100:00100000:2.0:1788642422.204521:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107449600 00000100:00100000:2.0:1788642422.204570:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788642422.204579:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:15801:x1875527107449600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788642422.205622:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:15801:x1875527107449600:12345-0@lo:502:mount.lustre.0 Request processed in 1040us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642422.205642:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788642422.205813:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6339180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788642422.206187:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788642422.206241:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788642422.206270:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788642422.206310:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788642422.206473:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788642422.206540:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788642422.206575:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788642422.206598:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788642422.206624:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788642422.208792:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788642422.208837:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788642422.208911:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788642422.208966:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788642422.208997:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788642422.209040:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788642422.209069:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788642422.210989:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788642422.211151:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788642422.211193:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788642422.211224:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788642422.211268:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788642422.211307:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788642422.211360:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788642422.211412:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788642422.211445:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788642422.211495:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788642422.211555:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788642422.211589:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788642422.211617:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788642422.211697:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788642422.211733:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788642422.211774:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788642422.211819:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788642422.211895:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788642422.211938:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788642422.211998:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788642422.212029:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788642422.212056:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788642422.212128:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788642422.212160:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788642422.212210:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788642422.212283:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642422.212330:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc656b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788642422.212503:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107449728 00000100:00100000:2.0:1788642422.212510:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107449728 00000100:00100000:2.0:1788642422.212563:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788642422.212572:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:15801:x1875527107449728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788642422.212808:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:15801:x1875527107449728:12345-0@lo:502:mount.lustre.0 Request processed in 236us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642422.212815:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788642422.212986:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788642422.213076:0:15801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788642422.213091:0:15801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788642422.216223:0:15811:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788642422.216242:0:15811:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8dddc4e00000) 00000020:00000080:0.0:1788642422.216265:0:15811:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788642422.216339:0:15811:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dddefa29000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788642422.216343:0:15811:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dddefa29000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788642422.216346:0:15811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dddefa29000 3 00010000:00080000:0.0:1788642422.216381:0:15811:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dddfa6da800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.149@tcp at head 00010000:00010000:1.0:1788642422.221901:0:15811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788642422.222151:0:15811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788642422.222194:0:15811:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788642422.222210:0:15811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4ae1ee156666e430 00000100:00080000:1.0:1788642422.222221:0:15811:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788642422.222226:0:15811:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dddfa6da800 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:1.0:1788642422.222262:0:15811:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfad1ed80 x1875527107449856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788642422.222290:0:15811:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788642422.222628:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1875527107449856:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788642422.222777:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642422.222834:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107449856 00000100:00100000:2.0:1788642422.222847:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107449856 00000100:00100000:2.0:1788642422.222880:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788642422.222887:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1875527107449856:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788642422.222909:0:14395:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:2.0:1788642422.223231:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4ae1ee156666e437 00000004:00100000:2.0:1788642422.223248:0:14395:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788642422.223283:0:14395:0:(import.c:65:import_set_state_nolock()) ffff8dddfaee6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788642422.223340:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875527107449856:12345-0@lo:38:llog_process_th.0 Request processed in 453us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642422.223562:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788642422.223605:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dddfad1ed80 x1875527107449856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788642432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642422.223616:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788642422.223624:0:3316:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788642422.224423:0:3316:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788642422.224432:0:3316:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788642422.224435:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddfa6da800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788642422.224442:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1875527107449856:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788642422.232091:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788642422.232697:0:15801:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788642422.232726:0:15801:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788642422.232769:0:15801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666e41b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e422 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642422.232782:0:15801:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddd6121000/0x4ae1ee156666e41b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e422 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788642422.232838:0:15801:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788642422.232840:0:15801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788642422.232842:0:15801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788642422.232843:0:15801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788642422.232844:0:15801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788642422.232845:0:15801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788642422.232846:0:15801:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788642422.232849:0:15801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788642422.232855:0:15801:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788642422.232860:0:15801:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788642422.232862:0:15801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788642422.232863:0:15801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788642422.232864:0:15801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788642422.232865:0:15801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788642422.232866:0:15801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788642422.232867:0:15801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788642422.232868:0:15801:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788642422.232869:0:15801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788642422.232869:0:15801:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788642422.232896:0:15801:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788642422.232917:0:15801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449984:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788642422.233003:0:15801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642422.233053:0:15801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc12ede40 going to sleep for 11 seconds 00000100:00100000:2.0:1788642422.234758:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107449984 00000100:00100000:2.0:1788642422.234768:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107449984 00000100:00100000:2.0:1788642422.234814:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788642422.234820:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:15801:x1875527107449984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788642422.236046:0:14390:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788642422.236062:0:14390:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788642422.277645:0:14390:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788642422.277665:0:14390:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788642422.277781:0:14411:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788642422.277787:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788642422.277808:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.277826:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddfd6e1000/0x4ae1ee156666e311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e30a expref: 19 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.277835:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.277875:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddfd6e1000/0x4ae1ee156666e311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666e30a expref: 19 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.277890:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddfd6e1000/0x4ae1ee156666e311 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666e30a expref: 19 pid: 14390 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642422.277911:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1875527107450112:0@lo:104: 00000100:00100000:1.0:1788642422.277987:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642422.278042:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddd0d6a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788642422.278064:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107450112 00000100:00100000:1.0:1788642422.278070:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107450112 00000100:00100000:1.0:1788642422.278134:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788642422.278144:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+3:14411:x1875527107450112:12345-0@lo:104: 00010000:00010000:1.0:1788642422.278158:0:14379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e311 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278218:0:14379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788642422.278225:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+3:14411:x1875527107450112:12345-0@lo:104: Request processed in 82us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642422.278233:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788642422.278248:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1875527107450112:0@lo:104: 00010000:00010000:1.0:1788642422.278256:0:15570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642422.278261:0:15570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e311 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278268:0:15570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffab000 already unused, calling callback (ffffffffc1b92c20) 00010000:00010000:3.0:1788642422.278269:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788642422.278272:0:15570:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666e311 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278281:0:15570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666e311 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788642422.278289:0:15570:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666e311 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642422.278306:0:15570:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788642422.278337:0:15570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e311 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278344:0:15570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788642422.278365:0:15570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e311 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278371:0:15570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddeffab000/0x4ae1ee156666e30a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e311 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642422.278374:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3317:1875527107450240:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788642422.278386:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642422.278388:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642422.278390:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642422.278402:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642422.278490:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107450240 00000100:00100000:1.0:1788642422.278495:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107450240 00010000:00010000:1.0:1788642422.278512:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddfd6e1000/0x4ae1ee156666e311 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e30a expref: 20 pid: 14390 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642422.278538:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788642422.278545:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+20:3317:x1875527107450240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788642422.278555:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642422.278560:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddfd6e1000/0x4ae1ee156666e311 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e30a expref: 20 pid: 14390 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278571:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddfd6e1000/0x4ae1ee156666e311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666e30a expref: 20 pid: 14390 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278585:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfd6e1000/0x4ae1ee156666e311 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666e30a expref: 20 pid: 14390 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278607:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278615:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788642422.278627:0:14382:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001795938s 00010000:00010000:1.0:1788642422.278631:0:14382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278637:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278645:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278651:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278657:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642422.278661:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278668:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278689:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642422.278699:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642422.278717:0:14411:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642422.278725:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642422.278731:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfb3ba200/0x4ae1ee156666e43e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642422.278737:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3317:x1875527107450240:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642422.278744:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788642422.278775:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3317:1875527107450240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788642422.284969:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:15801:x1875527107449984:12345-0@lo:253:mount.lustre.0 Request processed in 50130us (51949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642422.284985:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788642422.285209:0:15801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:228e481e-56eb-4de3-bc1a-1dbb71f0c898:15801:1875527107449984:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788642422.285226:0:15801:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788642422.285230:0:15801:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788642422.285232:0:15801:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788642422.285234:0:15801:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788642422.285235:0:15801:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788642422.285236:0:15801:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788642422.285238:0:15801:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788642422.285239:0:15801:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788642422.285241:0:15801:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788642422.285242:0:15801:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788642422.285258:0:15801:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788642422.290270:0:15801:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788642422.290413:0:15801:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788642422.290547:0:15801:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788642422.290719:0:15801:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788642422.290983:0:15801:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788642422.296917:0:15801:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788642422.298316:0:15801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788642422.445560:0:15801:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788642422.445568:0:15801:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788642422.445609:0:15801:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788642422.445673:0:15801:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.149@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788642422.445693:0:15801:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788642422.445723:0:15801:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788642423.035372:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788642423.674775:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788642423.678343:0:14393:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788642423.678352:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dddf7f24800 from 8 10000000:01000000:1.0:1788642423.678357:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788642423.678401:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb600/0x4ae1ee156666e445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642423.678415:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb600/0x4ae1ee156666e445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642423.678426:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb600/0x4ae1ee156666e445 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642423.678451:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107450368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788642423.678532:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642423.682072:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc7e72780 going to sleep for 11 seconds 00000100:00100000:2.0:1788642423.691301:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107450368 00000100:00100000:2.0:1788642423.691317:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107450368 00000100:00100000:2.0:1788642423.691882:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788642423.691892:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:14393:x1875527107450368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642423.691907:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642423.691923:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e44c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e445 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642423.691963:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e44c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e445 expref: 19 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642423.691974:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e1200/0x4ae1ee156666e44c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e445 expref: 19 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642423.691984:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1200, rc 0) 00000100:00100000:2.0:1788642423.692062:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:14393:x1875527107450368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (13541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642423.692067:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788642423.692129:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107450368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642423.692144:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb600/0x4ae1ee156666e445 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e44c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642423.692152:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb600/0x4ae1ee156666e445 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e44c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642423.692221:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa881500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107450496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788642423.692254:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642423.701438:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfd7bd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642423.708334:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107450496 00000100:00100000:3.0:1788642423.708352:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107450496 00000100:00100000:3.0:1788642423.708496:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788642423.708507:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:14393:x1875527107450496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788642423.709705:0:14387:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788642423.709731:0:14387:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788642423.709734:0:14387:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788642423.709871:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:14393:x1875527107450496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1364us (17613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642423.709881:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788642423.715934:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa881500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107450496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788642423.716296:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788642423.716308:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb600/0x4ae1ee156666e445 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e44c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642423.716320:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bb600/0x4ae1ee156666e445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e44c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642424.059766:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642425.082344:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642426.107758:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642427.066410:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107450624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788642427.066477:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642427.066562:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107450624 00000100:00100000:0.0:1788642427.066570:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107450624 00000100:00100000:0.0:1788642427.066626:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788642427.066634:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107450624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788642427.066665:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788642427.066703:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107450624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642427.066710:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788642427.066729:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788642427.066766:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107450624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788642427.136938:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788642427.584689:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788642427.584695:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788642427.584699:0:37:0:(import.c:65:import_set_state_nolock()) ffff8dddc9efa000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788642427.584707:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:2.0:1788642427.584711:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788642427.584718:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dddc9efa000 using connection 192.168.202.149@tcp/0@lo 00000100:00100000:2.0:1788642427.584740:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dddfa883b80 x1875527107451008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788642427.584939:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107450752:0@lo:400:kworker.0 00000100:00100000:2.0:1788642427.585013:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642427.585056:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107451392:0@lo:400:kworker.0 00000100:00100000:2.0:1788642427.585080:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642427.585125:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788642427.585131:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107450880:0@lo:400:kworker.0 00000100:00100000:2.0:1788642427.585160:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642427.585189:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107451008:0@lo:8:kworker.0 00000100:00100000:2.0:1788642427.585220:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642427.585245:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107451136:0@lo:400:kworker.0 00000100:00100000:2.0:1788642427.585266:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642427.585280:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788642427.585285:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107451264:0@lo:400:kworker.0 00000100:00100000:2.0:1788642427.585305:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642427.585335:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107450752 00000100:00100000:2.0:1788642427.585342:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107450752 00000100:00100000:2.0:1788642427.585383:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788642427.585392:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3319:x1875527107450752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642427.585437:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3319:x1875527107450752:12345-0@lo:400:kworker.0 Request processed in 45us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642427.585444:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788642427.585476:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107451392 00000100:00100000:2.0:1788642427.585479:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107451392 00000100:00100000:2.0:1788642427.585512:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107451136 00000100:00100000:2.0:1788642427.585516:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107451136 00000100:00100000:2.0:1788642427.585526:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107451264 00000100:00100000:2.0:1788642427.585528:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107451264 00000100:00100000:2.0:1788642427.585544:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788642427.585550:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107451392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642427.585579:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107451392:12345-0@lo:400:kworker.0 Request processed in 30us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642427.585585:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788642427.585598:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788642427.585604:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107451136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642427.585631:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107451136:12345-0@lo:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642427.585642:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788642427.585657:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788642427.585662:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107451264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642427.585687:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107451264:12345-0@lo:400:kworker.0 Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642427.585693:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788642427.585709:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107450880 00000100:00100000:2.0:1788642427.585712:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107450880 00000100:00100000:2.0:1788642427.585733:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107451008 00000100:00100000:2.0:1788642427.585736:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107451008 00000100:00100000:2.0:1788642427.585746:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788642427.585752:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107450880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642427.585779:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107450880:12345-0@lo:400:kworker.0 Request processed in 27us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642427.585785:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788642427.585797:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788642427.585801:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3316:x1875527107451008:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788642427.585823:0:15082:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:2.0:1788642427.585851:0:15082:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4ae1ee156666e453 00002000:00100000:2.0:1788642427.585866:0:15082:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dddfaee7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788642427.585870:0:15082:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788642427.585873:0:15082:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788642427.586223:0:15082:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788642427.586244:0:15082:0:(import.c:65:import_set_state_nolock()) ffff8dddfaee7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788642427.586280:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1875527107451008:12345-0@lo:8:kworker.0 Request processed in 476us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642427.586293:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788642427.586344:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107450880:0@lo:400:kworker.0 00000100:00100000:2.0:1788642427.586356:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107450752:0@lo:400:kworker.0 00010000:00080000:2.0:1788642427.586368:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfa882680 x1875527107451392/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642427.586378:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107451392:0@lo:400:kworker.0 00000100:00080000:2.0:1788642427.586402:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788642427.586419:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfa880000 x1875527107451264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642427.586428:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107451264:0@lo:400:kworker.0 00010000:00080000:2.0:1788642427.586437:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfa880700 x1875527107451136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788642443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642427.586445:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107451136:0@lo:400:kworker.0 00010000:00080000:2.0:1788642427.586469:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfa883b80 x1875527107451008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788642452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642427.586476:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788642427.586482:0:3316:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788642427.586490:0:3316:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788642427.586494:0:3316:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788642427.586496:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8dddc9efa000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788642427.586513:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788642427.586517:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1875527107451008:0@lo:8:kworker.0 00000004:00080000:2.0:1788642427.586636:0:14421:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788642427.586653:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14421:1875527107451648:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788642427.586680:0:14421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642427.586697:0:14421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddde0b5ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788642427.586711:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107451520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642427.586732:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642427.586762:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107451648 00000100:00100000:2.0:1788642427.586766:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107451648 00000100:00100000:2.0:1788642427.586793:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788642427.586800:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14421:x1875527107451648:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788642427.592063:0:14420:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788642427.592555:0:14420:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 515053455519ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788642427.594092:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107451520 00000100:00100000:2.0:1788642427.594126:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107451520 00000100:00100000:2.0:1788642427.594191:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788642427.594203:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1875527107451520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788642427.594243:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642427.594338:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1875527107451520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (7604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642427.594347:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788642427.594369:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788642427.596943:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dddfa883b80 x1875527107451520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788642443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788642427.596972:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107451520:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1788642427.602133:0:15082:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788642427.602144:0:15082:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788642427.602149:0:15082:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1788642427.626850:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788642427.626868:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f61fba3c/0x4ae1ee156666e45a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.626886:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788642427.626892:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642427.626899:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f61fba3c/0x4ae1ee156666e45a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.626929:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f61fba3c/0x4ae1ee156666e45a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.626940:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f61fba3c/0x4ae1ee156666e45a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.626947:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f61fba3c/0x4ae1ee156666e45a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.626967:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788642427.626983:0:15570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788642427.626988:0:15570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f61fba3c/0x4ae1ee156666e45a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.626996:0:15570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642427.627000:0:15570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f61fba3c/0x4ae1ee156666e45a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.627009:0:15570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f61fba3c/0x4ae1ee156666e45a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.627033:0:15570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f61fba3c/0x4ae1ee156666e45a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.627042:0:15570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f61fba3c/0x4ae1ee156666e45a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.627060:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642427.627062:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642427.627064:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788642427.629982:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788642427.629996:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e461 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.630012:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=515s v=(0 0) 00010000:00010000:2.0:1788642427.630016:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642427.630022:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e461 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.630034:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e461 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.630045:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e461 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.630053:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e461 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.630086:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788642427.632792:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642427.632807:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e461 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642427.632822:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1e00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642427.632827:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e461 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642427.632839:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e461 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642427.632863:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e461 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642427.632872:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045f53aba/0x4ae1ee156666e461 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642427.632898:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642427.632901:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642427.632912:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788642427.633503:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.633513:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007149924/0x4ae1ee156666e468 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.633526:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.633531:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.633615:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007149924/0x4ae1ee156666e468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.633631:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007149924/0x4ae1ee156666e468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.633718:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007149924/0x4ae1ee156666e468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.633726:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007149924/0x4ae1ee156666e468 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.633753:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788642427.634390:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.634397:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b68a9d8/0x4ae1ee156666e46f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.634410:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.634414:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.634418:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b68a9d8/0x4ae1ee156666e46f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.634427:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b68a9d8/0x4ae1ee156666e46f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.634434:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b68a9d8/0x4ae1ee156666e46f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.634441:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b68a9d8/0x4ae1ee156666e46f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.634454:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788642427.634662:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788642427.634669:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007149924/0x4ae1ee156666e468 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.634677:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffabe00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642427.634681:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007149924/0x4ae1ee156666e468 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.634689:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007149924/0x4ae1ee156666e468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.634705:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007149924/0x4ae1ee156666e468 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.634713:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007149924/0x4ae1ee156666e468 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.634730:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788642427.634734:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b68a9d8/0x4ae1ee156666e46f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.634740:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffab200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642427.634744:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b68a9d8/0x4ae1ee156666e46f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.634764:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b68a9d8/0x4ae1ee156666e46f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.634775:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b68a9d8/0x4ae1ee156666e46f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.634782:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b68a9d8/0x4ae1ee156666e46f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.634795:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642427.634797:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642427.634798:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642427.634805:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788642427.640339:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.640351:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c701c295/0x4ae1ee156666e476 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.640369:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.640374:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.640381:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c701c295/0x4ae1ee156666e476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.640399:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c701c295/0x4ae1ee156666e476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.640426:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c701c295/0x4ae1ee156666e476 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.640435:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c701c295/0x4ae1ee156666e476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.640452:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788642427.640763:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642427.640771:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c701c295/0x4ae1ee156666e476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642427.640779:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaa200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642427.640784:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c701c295/0x4ae1ee156666e476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642427.640808:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c701c295/0x4ae1ee156666e476 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642427.640828:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c701c295/0x4ae1ee156666e476 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642427.640837:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c701c295/0x4ae1ee156666e476 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642427.640858:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642427.640860:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642427.640862:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788642427.653529:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.653557:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058ebb0bd/0x4ae1ee156666e47d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.653575:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.653579:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.653586:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058ebb0bd/0x4ae1ee156666e47d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.653601:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058ebb0bd/0x4ae1ee156666e47d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.653612:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058ebb0bd/0x4ae1ee156666e47d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.653618:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058ebb0bd/0x4ae1ee156666e47d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.653673:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788642427.654294:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.654300:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e484 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.654308:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.654311:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.654315:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.654325:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.654333:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.654340:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.654365:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788642427.654758:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.654763:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000605bd3bf/0x4ae1ee156666e48b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.654771:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.654780:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.654784:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000605bd3bf/0x4ae1ee156666e48b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.654794:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000605bd3bf/0x4ae1ee156666e48b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.654802:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000605bd3bf/0x4ae1ee156666e48b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.654809:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000605bd3bf/0x4ae1ee156666e48b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.654824:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788642427.655229:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.655235:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035dd6092/0x4ae1ee156666e492 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.655243:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.655246:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.655250:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035dd6092/0x4ae1ee156666e492 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.655258:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035dd6092/0x4ae1ee156666e492 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.655265:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035dd6092/0x4ae1ee156666e492 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.655278:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035dd6092/0x4ae1ee156666e492 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.655285:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788642427.655436:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788642427.655446:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058ebb0bd/0x4ae1ee156666e47d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655535:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffab000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.655542:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058ebb0bd/0x4ae1ee156666e47d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655552:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058ebb0bd/0x4ae1ee156666e47d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655576:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058ebb0bd/0x4ae1ee156666e47d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655665:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058ebb0bd/0x4ae1ee156666e47d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788642427.655690:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788642427.655692:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788642427.655701:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.655702:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f077577/0x4ae1ee156666e499 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655721:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaa000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:3.0:1788642427.655723:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788642427.655725:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.655729:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.655738:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f077577/0x4ae1ee156666e499 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655740:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e484 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.655758:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f077577/0x4ae1ee156666e499 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655763:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e484 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.655771:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f077577/0x4ae1ee156666e499 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655775:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e484 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.655786:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f077577/0x4ae1ee156666e499 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655795:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788642427.655797:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788642427.655800:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000605bd3bf/0x4ae1ee156666e48b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655808:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffab600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.655819:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000605bd3bf/0x4ae1ee156666e48b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655828:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000605bd3bf/0x4ae1ee156666e48b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655840:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000605bd3bf/0x4ae1ee156666e48b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655847:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000605bd3bf/0x4ae1ee156666e48b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655863:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788642427.655866:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035dd6092/0x4ae1ee156666e492 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655873:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaae00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.655877:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035dd6092/0x4ae1ee156666e492 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655885:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035dd6092/0x4ae1ee156666e492 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655896:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035dd6092/0x4ae1ee156666e492 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655915:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035dd6092/0x4ae1ee156666e492 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655937:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642427.655941:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f077577/0x4ae1ee156666e499 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655949:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaa400 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.655952:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f077577/0x4ae1ee156666e499 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655961:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f077577/0x4ae1ee156666e499 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655972:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f077577/0x4ae1ee156666e499 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655980:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f077577/0x4ae1ee156666e499 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.655993:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.655995:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.655997:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.656156:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788642427.656296:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.656301:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000384caf78/0x4ae1ee156666e4a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.656316:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.656319:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.656323:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000384caf78/0x4ae1ee156666e4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.656333:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000384caf78/0x4ae1ee156666e4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.656340:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000384caf78/0x4ae1ee156666e4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.656347:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000384caf78/0x4ae1ee156666e4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.656367:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642427.656650:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642427.656656:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000384caf78/0x4ae1ee156666e4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.656664:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaaa00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.656674:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000384caf78/0x4ae1ee156666e4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.656684:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000384caf78/0x4ae1ee156666e4a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.656697:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000384caf78/0x4ae1ee156666e4a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.656705:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000384caf78/0x4ae1ee156666e4a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.656722:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.656725:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.656727:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788642427.656757:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.656763:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003313c5aa/0x4ae1ee156666e4a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.656771:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.656774:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.656778:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003313c5aa/0x4ae1ee156666e4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.656787:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003313c5aa/0x4ae1ee156666e4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.656806:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003313c5aa/0x4ae1ee156666e4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.656812:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003313c5aa/0x4ae1ee156666e4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.656835:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642427.656932:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642427.656936:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003313c5aa/0x4ae1ee156666e4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.656943:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.656946:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003313c5aa/0x4ae1ee156666e4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.656954:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003313c5aa/0x4ae1ee156666e4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.656964:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003313c5aa/0x4ae1ee156666e4a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.656977:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003313c5aa/0x4ae1ee156666e4a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.656991:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.656993:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.656995:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642427.658331:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788642427.667132:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.667145:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad080e69/0x4ae1ee156666e4ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.667163:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.667168:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.667175:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad080e69/0x4ae1ee156666e4ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.667191:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad080e69/0x4ae1ee156666e4ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.667203:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad080e69/0x4ae1ee156666e4ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.667211:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad080e69/0x4ae1ee156666e4ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.667245:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642427.671016:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642427.671032:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad080e69/0x4ae1ee156666e4ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.671045:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f8c00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.671051:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad080e69/0x4ae1ee156666e4ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.671063:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad080e69/0x4ae1ee156666e4ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.671086:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad080e69/0x4ae1ee156666e4ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.671094:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad080e69/0x4ae1ee156666e4ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.671147:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.671149:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.671151:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788642427.672010:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.672021:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dce7fdf/0x4ae1ee156666e4b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.672034:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.672039:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.672045:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dce7fdf/0x4ae1ee156666e4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.672058:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dce7fdf/0x4ae1ee156666e4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.672067:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dce7fdf/0x4ae1ee156666e4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.672074:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dce7fdf/0x4ae1ee156666e4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.672116:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642427.672173:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642427.672181:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dce7fdf/0x4ae1ee156666e4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.672190:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.672193:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dce7fdf/0x4ae1ee156666e4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.672204:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dce7fdf/0x4ae1ee156666e4b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.672219:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dce7fdf/0x4ae1ee156666e4b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.672228:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dce7fdf/0x4ae1ee156666e4b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.672246:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.672248:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.672250:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788642427.676995:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.677011:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000066d9344/0x4ae1ee156666e4bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.677028:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.677041:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.677047:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000066d9344/0x4ae1ee156666e4bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.677062:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000066d9344/0x4ae1ee156666e4bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.677073:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000066d9344/0x4ae1ee156666e4bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.677080:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000066d9344/0x4ae1ee156666e4bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.677121:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788642427.677512:0:15570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788642427.677520:0:15570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000066d9344/0x4ae1ee156666e4bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.677528:0:15570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f8e00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642427.677533:0:15570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000066d9344/0x4ae1ee156666e4bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.677555:0:15570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000066d9344/0x4ae1ee156666e4bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.677575:0:15570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000066d9344/0x4ae1ee156666e4bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.677589:0:15570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000066d9344/0x4ae1ee156666e4bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.677611:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642427.677613:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642427.677614:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788642427.678188:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788642427.679353:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.679362:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1323271/0x4ae1ee156666e4c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.679376:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.679380:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.679386:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1323271/0x4ae1ee156666e4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.679398:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1323271/0x4ae1ee156666e4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.679424:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1323271/0x4ae1ee156666e4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.679438:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1323271/0x4ae1ee156666e4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.679462:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788642427.679950:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.679957:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071762ee6/0x4ae1ee156666e4ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.679966:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.679970:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.679974:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071762ee6/0x4ae1ee156666e4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.679983:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071762ee6/0x4ae1ee156666e4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.679991:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071762ee6/0x4ae1ee156666e4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.679998:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071762ee6/0x4ae1ee156666e4ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.680014:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788642427.680452:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.680459:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecde31d2/0x4ae1ee156666e4d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.680475:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.680477:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.680482:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecde31d2/0x4ae1ee156666e4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.680492:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecde31d2/0x4ae1ee156666e4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.680499:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecde31d2/0x4ae1ee156666e4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.680507:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecde31d2/0x4ae1ee156666e4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.680520:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788642427.680896:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.680914:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087dc72f4/0x4ae1ee156666e4d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.680923:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.680926:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.680930:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087dc72f4/0x4ae1ee156666e4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.680940:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087dc72f4/0x4ae1ee156666e4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.680960:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087dc72f4/0x4ae1ee156666e4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.680966:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087dc72f4/0x4ae1ee156666e4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.680974:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788642427.681379:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.681386:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052624dc7/0x4ae1ee156666e4df lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.681395:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.681397:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.681401:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052624dc7/0x4ae1ee156666e4df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.681409:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052624dc7/0x4ae1ee156666e4df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.681416:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052624dc7/0x4ae1ee156666e4df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.681423:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052624dc7/0x4ae1ee156666e4df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.681440:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788642427.681809:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.681814:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe195729/0x4ae1ee156666e4e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.681823:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.681826:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.681830:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe195729/0x4ae1ee156666e4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.681839:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe195729/0x4ae1ee156666e4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.681846:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe195729/0x4ae1ee156666e4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.681853:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe195729/0x4ae1ee156666e4e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.681862:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1788642427.682355:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788642427.682364:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1323271/0x4ae1ee156666e4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682373:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f8600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642427.682377:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1323271/0x4ae1ee156666e4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682386:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1323271/0x4ae1ee156666e4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682417:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1323271/0x4ae1ee156666e4c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682425:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1323271/0x4ae1ee156666e4c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682451:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788642427.682455:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071762ee6/0x4ae1ee156666e4ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682470:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f8400 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642427.682472:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071762ee6/0x4ae1ee156666e4ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682480:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071762ee6/0x4ae1ee156666e4ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682490:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071762ee6/0x4ae1ee156666e4ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682496:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071762ee6/0x4ae1ee156666e4ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682509:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788642427.682513:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecde31d2/0x4ae1ee156666e4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682519:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642427.682522:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecde31d2/0x4ae1ee156666e4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682528:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecde31d2/0x4ae1ee156666e4d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682548:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecde31d2/0x4ae1ee156666e4d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682560:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecde31d2/0x4ae1ee156666e4d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682576:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788642427.682580:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087dc72f4/0x4ae1ee156666e4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682586:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f8000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642427.682590:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087dc72f4/0x4ae1ee156666e4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682598:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087dc72f4/0x4ae1ee156666e4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682607:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087dc72f4/0x4ae1ee156666e4d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682614:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087dc72f4/0x4ae1ee156666e4d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682626:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788642427.682629:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052624dc7/0x4ae1ee156666e4df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682767:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9c00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642427.682776:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052624dc7/0x4ae1ee156666e4df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682784:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052624dc7/0x4ae1ee156666e4df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682793:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052624dc7/0x4ae1ee156666e4df lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682799:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052624dc7/0x4ae1ee156666e4df lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682810:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788642427.682813:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe195729/0x4ae1ee156666e4e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682818:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9400 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642427.682821:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe195729/0x4ae1ee156666e4e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682827:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe195729/0x4ae1ee156666e4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682834:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe195729/0x4ae1ee156666e4e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682840:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe195729/0x4ae1ee156666e4e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.682856:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642427.682858:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642427.682860:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642427.682869:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.682925:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788642427.687452:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.687467:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d274dc9e/0x4ae1ee156666e4ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.687484:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.687495:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.687502:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d274dc9e/0x4ae1ee156666e4ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.687517:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d274dc9e/0x4ae1ee156666e4ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.687528:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d274dc9e/0x4ae1ee156666e4ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.687546:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d274dc9e/0x4ae1ee156666e4ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.687571:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788642427.688094:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.688129:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af11d932/0x4ae1ee156666e4f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.688137:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.688140:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.688145:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af11d932/0x4ae1ee156666e4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.688154:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af11d932/0x4ae1ee156666e4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.688163:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af11d932/0x4ae1ee156666e4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.688176:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af11d932/0x4ae1ee156666e4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.688190:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788642427.688583:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.688589:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb32a62/0x4ae1ee156666e4fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.688599:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.688602:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.688606:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb32a62/0x4ae1ee156666e4fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.688615:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fb32a62/0x4ae1ee156666e4fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.688623:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb32a62/0x4ae1ee156666e4fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.688629:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fb32a62/0x4ae1ee156666e4fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.688651:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788642427.689030:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.689037:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4caf8d8/0x4ae1ee156666e502 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.689052:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.689055:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.689059:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4caf8d8/0x4ae1ee156666e502 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.689069:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4caf8d8/0x4ae1ee156666e502 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.689077:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4caf8d8/0x4ae1ee156666e502 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.689085:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4caf8d8/0x4ae1ee156666e502 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.689093:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788642427.689438:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00002000:00010000:3.0:1788642427.689501:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.689506:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f210eb04/0x4ae1ee156666e509 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.689514:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=515s v=(0 0) 00010000:00010000:0.0:1788642427.689517:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d274dc9e/0x4ae1ee156666e4ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.689518:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.689527:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f210eb04/0x4ae1ee156666e509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689534:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494fc00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.689542:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d274dc9e/0x4ae1ee156666e4ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.689543:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f210eb04/0x4ae1ee156666e509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.689585:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f210eb04/0x4ae1ee156666e509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.689591:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f210eb04/0x4ae1ee156666e509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.689600:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788642427.689713:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d274dc9e/0x4ae1ee156666e4ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689733:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d274dc9e/0x4ae1ee156666e4ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689741:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d274dc9e/0x4ae1ee156666e4ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689762:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788642427.689766:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af11d932/0x4ae1ee156666e4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689773:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494e000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.689776:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af11d932/0x4ae1ee156666e4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689784:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af11d932/0x4ae1ee156666e4f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689795:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af11d932/0x4ae1ee156666e4f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689802:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af11d932/0x4ae1ee156666e4f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689827:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788642427.689830:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fb32a62/0x4ae1ee156666e4fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689836:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494ee00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.689839:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb32a62/0x4ae1ee156666e4fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689846:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb32a62/0x4ae1ee156666e4fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689856:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fb32a62/0x4ae1ee156666e4fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689863:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fb32a62/0x4ae1ee156666e4fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689878:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788642427.689882:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4caf8d8/0x4ae1ee156666e502 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689887:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494f800 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.689890:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4caf8d8/0x4ae1ee156666e502 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689920:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4caf8d8/0x4ae1ee156666e502 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689931:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4caf8d8/0x4ae1ee156666e502 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689939:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4caf8d8/0x4ae1ee156666e502 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689954:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642427.689957:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f210eb04/0x4ae1ee156666e509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689963:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494ea00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.689966:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f210eb04/0x4ae1ee156666e509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689974:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f210eb04/0x4ae1ee156666e509 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642427.689976:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788642427.689986:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.689987:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f210eb04/0x4ae1ee156666e509 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.689996:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f210eb04/0x4ae1ee156666e509 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.690019:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.690021:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.690024:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788642427.701860:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788642427.701872:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f47a0824/0x4ae1ee156666e510 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.701889:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=515s v=(0 0) 00010000:00010000:3.0:1788642427.701894:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642427.701900:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f47a0824/0x4ae1ee156666e510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.701924:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f47a0824/0x4ae1ee156666e510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.701934:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f47a0824/0x4ae1ee156666e510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.701942:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f47a0824/0x4ae1ee156666e510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642427.701977:0:15082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788642427.702140:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642427.702148:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f47a0824/0x4ae1ee156666e510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.702158:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494e800 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642427.702163:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f47a0824/0x4ae1ee156666e510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.702173:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f47a0824/0x4ae1ee156666e510 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.702190:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f47a0824/0x4ae1ee156666e510 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.702198:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f47a0824/0x4ae1ee156666e510 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642427.702219:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.702222:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642427.702225:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788642427.702306:0:15082:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788642427.702403:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14421:x1875527107451648:12345-0@lo:5:osp-pre-1-0.0 Request processed in 115600us (115718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642427.702415:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788642427.702500:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14421:1875527107451648:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788642427.702518:0:14421:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788642427.702575:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14421:1875527107451776:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788642427.702728:0:14421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642427.702769:0:14421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc734db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788642427.702788:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107451776 00000100:00100000:0.0:1788642427.702794:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107451776 00000100:00100000:0.0:1788642427.702839:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788642427.702848:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14421:x1875527107451776:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788642427.702885:0:15083:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788642427.721977:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14421:x1875527107451776:12345-0@lo:5:osp-pre-1-0.0 Request processed in 19123us (19242us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788642427.721990:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788642427.722729:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14421:1875527107451776:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788642427.722745:0:14421:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1788642428.159007:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788642428.344638:0:16159:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg249-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788642429.181549:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642430.202658:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642431.228697:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642431.340454:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642431.340823:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086482816 00000100:00100000:2.0:1788642431.340837:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086482816 00000100:00100000:2.0:1788642431.340915:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00100000:2.0:1788642431.340926:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2358:x1875527086482816:12345-192.168.202.49@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788642431.340964:0:14389:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 90ca42bc-d1c2-4691-baf3-de9911d6e83e@192.168.202.49@tcp t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1788642431.341005:0:14389:0:(genops.c:1385:class_connect()) connect: client 90ca42bc-d1c2-4691-baf3-de9911d6e83e, cookie 0x4ae1ee156666e517 00000100:00080000:2.0:1788642431.341332:0:14389:0:(import.c:65:import_set_state_nolock()) ffff8dddfaee3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788642431.341611:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+5:2358:x1875527086482816:12345-192.168.202.49@tcp:250:mount.lustre.0 Request processed in 684us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642431.341620:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 76 00000100:00100000:0.0:1788642431.360790:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642431.361081:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086482944 00000100:00100000:2.0:1788642431.361093:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086482944 00000100:00100000:2.0:1788642431.361184:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00100000:2.0:1788642431.361195:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+5:13768:x1875527086482944:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788642431.361212:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642431.361230:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e0200/0x4ae1ee156666e51e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9b3d expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642431.361281:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e0200/0x4ae1ee156666e51e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b3d expref: 6 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642431.361294:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e0200/0x4ae1ee156666e51e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b3d expref: 6 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642431.361304:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0200, rc 0) 00000100:00100000:2.0:1788642431.361373:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+6:13768:x1875527086482944:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 179us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642431.361380:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 77 00000100:00100000:1.0:1788642431.369744:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642431.369912:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086483072 00000100:00100000:3.0:1788642431.369924:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086483072 00000100:00100000:3.0:1788642431.369981:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 78 00000100:00100000:3.0:1788642431.369992:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfae99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+6:13768:x1875527086483072:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788642431.370323:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfae99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+6:13768:x1875527086483072:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 332us (596us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788642431.370331:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 78 00000100:00100000:1.0:1788642431.382703:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642431.383004:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086483200 00000100:00100000:0.0:1788642431.383014:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086483200 00000100:00100000:0.0:1788642431.383067:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:0.0:1788642431.383078:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+6:13768:x1875527086483200:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788642431.383094:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642431.383139:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666e525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9b44 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642431.383169:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666e525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b44 expref: 7 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642431.383180:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6121600/0x4ae1ee156666e525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b44 expref: 7 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642431.383205:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121600, rc 0) 00000100:00100000:0.0:1788642431.383262:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+7:13768:x1875527086483200:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 186us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642431.383269:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 79 00000100:00100000:0.0:1788642431.390200:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642431.390354:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086483328 00000100:00100000:2.0:1788642431.390365:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086483328 00000100:00100000:2.0:1788642431.390425:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:2.0:1788642431.390436:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+7:13768:x1875527086483328:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788642431.390760:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+8:13768:x1875527086483328:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 325us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642431.390769:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 80 00000100:00100000:1.0:1788642431.399601:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642431.399755:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086483456 00000100:00100000:3.0:1788642431.399766:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086483456 00000100:00100000:3.0:1788642431.399825:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:3.0:1788642431.399836:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+8:13768:x1875527086483456:12345-192.168.202.49@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788642431.400094:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+8:13768:x1875527086483456:12345-192.168.202.49@tcp:503:mount.lustre.0 Request processed in 258us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642431.400141:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 81 00000100:00100000:1.0:1788642431.404720:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642431.404838:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086483584 00000100:00100000:0.0:1788642431.404849:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086483584 00000100:00100000:0.0:1788642431.404920:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 82 00000100:00100000:0.0:1788642431.404932:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+8:13786:x1875527086483584:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788642431.405363:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+8:13786:x1875527086483584:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 432us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642431.405371:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 82 00000100:00100000:0.0:1788642431.451265:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642431.451374:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086483712 00000100:00100000:2.0:1788642431.451384:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086483712 00000100:00100000:2.0:1788642431.451438:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 83 00000100:00100000:2.0:1788642431.451447:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+8:13786:x1875527086483712:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788642431.451728:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+8:13786:x1875527086483712:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 281us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642431.451736:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 83 00000100:00100000:1.0:1788642431.458276:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642431.462602:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086483840 00000100:00100000:0.0:1788642431.462618:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086483840 00000100:00100000:0.0:1788642431.462707:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:0.0:1788642431.462720:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+8:13768:x1875527086483840:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788642431.462740:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642431.462761:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6121e00/0x4ae1ee156666e52c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9b6e expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642431.462792:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6121e00/0x4ae1ee156666e52c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b6e expref: 9 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642431.462806:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6121e00/0x4ae1ee156666e52c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b6e expref: 9 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642431.462830:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121e00, rc 0) 00000100:00100000:0.0:1788642431.462915:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+9:13768:x1875527086483840:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 198us (4649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642431.462922:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 84 00000100:00100000:1.0:1788642431.467622:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642431.467751:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086483968 00000100:00100000:3.0:1788642431.467762:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086483968 00000100:00100000:3.0:1788642431.467821:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:3.0:1788642431.467831:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+9:13768:x1875527086483968:12345-192.168.202.49@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788642431.467857:0:14387:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788642431.467890:0:14387:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788642431.467894:0:14387:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788642431.467898:0:14387:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788642431.467901:0:14387:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788642431.471267:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+9:13768:x1875527086483968:12345-192.168.202.49@tcp:256:mount.lustre.0 Request processed in 3425us (3643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642431.471282:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 85 00000100:00100000:1.0:1788642431.475966:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642431.476074:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086484096 00000100:00100000:2.0:1788642431.476126:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086484096 00000100:00100000:2.0:1788642431.476180:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 86 00000100:00100000:2.0:1788642431.476190:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+9:13768:x1875527086484096:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788642431.476206:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642431.476223:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e533 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9b75 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642431.476250:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b75 expref: 10 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642431.476261:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b75 expref: 10 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642431.476271:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0a00, rc 0) 00000100:00100000:2.0:1788642431.476325:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+10:13768:x1875527086484096:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 137us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642431.476333:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 86 00000100:00100000:1.0:1788642431.480484:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642431.480804:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086484224 00000100:00100000:3.0:1788642431.480815:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086484224 00000100:00100000:3.0:1788642431.480883:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 87 00000100:00100000:3.0:1788642431.480893:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+10:13768:x1875527086484224:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788642431.484391:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+10:13768:x1875527086484224:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 3489us (3904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642431.484406:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 87 00000100:00100000:3.0:1788642431.488717:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642431.488989:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086484352 00000100:00100000:1.0:1788642431.488998:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086484352 00000100:00100000:1.0:1788642431.489344:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:1.0:1788642431.489356:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+10:13768:x1875527086484352:12345-192.168.202.49@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788642431.489628:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+10:13768:x1875527086484352:12345-192.168.202.49@tcp:503:mount.lustre.0 Request processed in 275us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642431.489642:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 88 00000100:00100000:1.0:1788642431.493955:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642431.494155:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086484480 00000100:00100000:3.0:1788642431.494165:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086484480 00000100:00100000:3.0:1788642431.494221:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00100000:3.0:1788642431.494230:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+10:13788:x1875527086484480:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788642431.494505:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+10:13788:x1875527086484480:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 267us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642431.494522:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 89 00000100:00100000:3.0:1788642431.506351:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642431.506514:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086484608 00000100:00100000:1.0:1788642431.506524:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086484608 00000100:00100000:1.0:1788642431.506580:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00100000:1.0:1788642431.506590:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+10:13788:x1875527086484608:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788642431.507226:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+10:13788:x1875527086484608:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 634us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642431.507235:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 90 00000100:00100000:1.0:1788642431.527566:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642431.527934:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086484736 00000100:00100000:2.0:1788642431.527945:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086484736 00000100:00100000:2.0:1788642431.528056:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:2.0:1788642431.528065:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1875527086484736:12345-192.168.202.49@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788642431.528133:0:14397:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from adce0da7-4d4d-46cf-bea0-9514c5720b94@192.168.202.49@tcp t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1788642431.528184:0:14397:0:(genops.c:1385:class_connect()) connect: client adce0da7-4d4d-46cf-bea0-9514c5720b94, cookie 0x4ae1ee156666e53a 00000004:00100000:2.0:1788642431.528215:0:14397:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788642431.528221:0:14397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788642431.603021:0:14397:0:(import.c:65:import_set_state_nolock()) ffff8dddfd7cf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788642431.603141:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:2358:x1875527086484736:12345-192.168.202.49@tcp:38:mount.lustre.0 Request processed in 75074us (75584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642431.603151:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:2.0:1788642431.610191:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642431.610222:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642431.613032:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086484992 00000100:00100000:0.0:1788642431.613047:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086484992 00000100:00100000:0.0:1788642431.613182:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086484864 00000100:00100000:0.0:1788642431.613187:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086484864 00000100:00100000:0.0:1788642431.613209:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:0.0:1788642431.613219:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:13768:x1875527086484992:12345-192.168.202.49@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788642431.613266:0:14396:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788642431.613363:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:13768:x1875527086484992:12345-192.168.202.49@tcp:41:mount.lustre.0 Request processed in 145us (3181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642431.613370:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:0.0:1788642431.613388:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:0.0:1788642431.613395:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:0:x1875527086484864:12345-192.168.202.49@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788642431.613406:0:14396:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788642431.613440:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:0:x1875527086484864:12345-192.168.202.49@tcp:41:mount.lustre.0 Request processed in 45us (3217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642431.613446:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00080000:2.0:1788642431.613895:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642431.621916:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642431.622090:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086485120 00000100:00100000:0.0:1788642431.622136:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086485120 00000100:00100000:2.0:1788642431.624701:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:2.0:1788642431.624727:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:13768:x1875527086485120:12345-192.168.202.49@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788642431.624842:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:13768:x1875527086485120:12345-192.168.202.49@tcp:40:mount.lustre.0 Request processed in 126us (2935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642431.624850:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:0.0:1788642431.635362:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642431.635398:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642431.635427:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642431.635464:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086485248 00000100:00100000:0.0:1788642431.635473:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086485248 00000100:00100000:0.0:1788642431.635519:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086485376 00000100:00100000:0.0:1788642431.635522:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086485376 00000100:00100000:0.0:1788642431.635545:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:0.0:1788642431.635553:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875527086485248:12345-192.168.202.49@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788642431.635586:0:15080:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from adce0da7-4d4d-46cf-bea0-9514c5720b94@192.168.202.49@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:0.0:1788642431.635617:0:15080:0:(genops.c:1385:class_connect()) connect: client adce0da7-4d4d-46cf-bea0-9514c5720b94, cookie 0x4ae1ee156666e541 00002000:00100000:0.0:1788642431.635630:0:15080:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli adce0da7-4d4d-46cf-bea0-9514c5720b94/ffff8ddcc58aa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788642431.635654:0:15080:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788642431.635993:0:15080:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788642431.636024:0:15080:0:(import.c:65:import_set_state_nolock()) ffff8ddcc58ae000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788642431.636095:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:2358:x1875527086485248:12345-192.168.202.49@tcp:8:mount.lustre.0 Request processed in 540us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642431.636132:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:0.0:1788642431.636152:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:0.0:1788642431.636157:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875527086485376:12345-192.168.202.49@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788642431.636174:0:15080:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from adce0da7-4d4d-46cf-bea0-9514c5720b94@192.168.202.49@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:0.0:1788642431.636190:0:15080:0:(genops.c:1385:class_connect()) connect: client adce0da7-4d4d-46cf-bea0-9514c5720b94, cookie 0x4ae1ee156666e548 00002000:00100000:0.0:1788642431.636196:0:15080:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli adce0da7-4d4d-46cf-bea0-9514c5720b94/ffff8ddcc58af800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788642431.636211:0:15080:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788642431.636332:0:15080:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788642431.636348:0:15080:0:(import.c:65:import_set_state_nolock()) ffff8ddcc58ad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788642431.636371:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:2358:x1875527086485376:12345-192.168.202.49@tcp:8:mount.lustre.0 Request processed in 213us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642431.636389:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:3.0:1788642431.637705:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086485504 00000100:00100000:3.0:1788642431.637717:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086485504 00000100:00100000:3.0:1788642431.637766:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:3.0:1788642431.637776:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:13768:x1875527086485504:12345-192.168.202.49@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788642431.652326:0:14398:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 14489us 00000004:00200000:0.0:1788642431.658254:0:14398:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788642431.658377:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:13768:x1875527086485504:12345-192.168.202.49@tcp:33:mount.lustre.0 Request processed in 20596us (22942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642431.658394:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:0.0:1788642432.048050:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642432.048263:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086485632 00000100:00100000:1.0:1788642432.048273:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086485632 00000100:00100000:1.0:1788642432.048340:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:1.0:1788642432.048350:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:13808:x1875527086485632:12345-192.168.202.49@tcp:101:mkdir.0 00010000:00010000:1.0:1788642432.048370:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642432.048396:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e54f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9b9f expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642432.048463:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e556 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642432.048476:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642432.048503:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642432.048537:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788642432.048541:0:14395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642432.048591:0:14395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642432.048618:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba800/0x4ae1ee156666e54f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b9f expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642432.048636:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e556 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b9f expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642432.048645:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:1.0:1788642432.048648:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788642432.048652:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3bac00, rc 0) 00000100:00100000:1.0:1788642432.048713:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:13808:x1875527086485632:12345-192.168.202.49@tcp:101:mkdir.0 Request processed in 364us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642432.048720:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:1.0:1788642432.187728:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788642432.187756:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc6339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107451904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788642432.187843:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642432.188123:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107451904 00000100:00100000:2.0:1788642432.188132:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107451904 00000100:00100000:2.0:1788642432.188198:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788642432.188209:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107451904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788642432.188232:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642432.188292:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107451904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642432.188301:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788642432.188333:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc6339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107451904:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788642432.188454:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788642432.251762:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642432.698320:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ddcc633ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107452032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788642432.698403:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642432.698456:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107452032 00000100:00100000:1.0:1788642432.698465:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107452032 00000100:00080000:2.0:1788642432.698498:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788642432.698518:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788642432.698698:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107452160:0@lo:400:kworker.0 00000100:00100000:3.0:1788642432.698737:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642432.698761:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107452672:0@lo:400:kworker.0 00000100:00100000:3.0:1788642432.698786:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642432.698805:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642432.698810:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107452288:0@lo:400:kworker.0 00000100:00100000:3.0:1788642432.698831:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642432.698951:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107452416:0@lo:400:kworker.0 00000100:00100000:3.0:1788642432.698974:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642432.698992:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788642432.698997:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107452544:0@lo:400:kworker.0 00000100:00100000:3.0:1788642432.699017:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642432.699047:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107452672 00000100:00100000:3.0:1788642432.699053:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107452672 00000100:00100000:3.0:1788642432.699076:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107452416 00000100:00100000:3.0:1788642432.699079:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107452416 00000100:00100000:3.0:1788642432.699090:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107452544 00000100:00100000:3.0:1788642432.699123:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107452544 00000100:00100000:3.0:1788642432.699142:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788642432.699148:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107452672:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788642432.699229:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642432.699241:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107452160 00000100:00100000:2.0:1788642432.699245:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107452160 00000100:00100000:2.0:1788642432.699271:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788642432.699276:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3319:x1875527107452160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642432.699327:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3319:x1875527107452160:12345-0@lo:400:kworker.0 Request processed in 51us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642432.699335:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788642432.699349:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107452288 00000100:00100000:0.0:1788642432.699353:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107452288 00000100:00100000:0.0:1788642432.699377:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788642432.699381:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107452160:0@lo:400:kworker.0 00000100:00100000:0.0:1788642432.699384:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107452288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642432.699401:0:14396:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788642432.699408:0:14396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788642432.699427:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107452288:12345-0@lo:400:kworker.0 Request processed in 44us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642432.699431:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107452288:0@lo:400:kworker.0 00000100:00100000:0.0:1788642432.699433:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788642432.699543:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788642432.699550:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107452416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642432.699583:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107452416:12345-0@lo:400:kworker.0 Request processed in 34us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642432.699589:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788642432.699600:0:14396:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788642432.699606:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788642432.699612:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107452544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642432.699639:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107452544:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642432.699645:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788642432.699772:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107452544:0@lo:400:kworker.0 00000100:00100000:2.0:1788642432.699783:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107452416:0@lo:400:kworker.0 00000100:00100000:3.0:1788642432.700222:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107452672:12345-0@lo:400:kworker.0 Request processed in 1072us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642432.700230:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788642432.700473:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb40ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107452672:0@lo:400:kworker.0 00000100:00100000:1.0:1788642432.704363:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875527107452032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642432.704401:0:15085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642432.704602:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875527107452032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6060us (6196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642432.704611:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788642432.704907:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ddcc633ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107452032:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788642432.740742:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of adce0da7-4d4d-46cf-bea0-9514c5720b94 00000001:00080000:3.0:1788642432.740823:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788642432.740835:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788642433.277704:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788642433.291193:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of adce0da7-4d4d-46cf-bea0-9514c5720b94 00000040:00080000:0.0:1788642433.915085:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788642434.301183:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642434.333381:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.334012:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086485760 00000100:00100000:2.0:1788642434.334025:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086485760 00000100:00100000:2.0:1788642434.334170:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:2.0:1788642434.334190:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:13862:x1875527086485760:12345-192.168.202.49@tcp:41:lfs.0 00000004:00000024:2.0:1788642434.334622:0:14396:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788642434.334811:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:13862:x1875527086485760:12345-192.168.202.49@tcp:41:lfs.0 Request processed in 631us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642434.334821:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00080000:0.0:1788642434.335999:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642434.348481:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.348901:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086485888 00000100:00100000:2.0:1788642434.348916:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086485888 00000100:00100000:2.0:1788642434.349019:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:2.0:1788642434.349033:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:13862:x1875527086485888:12345-192.168.202.49@tcp:13:lfs.0 00002000:00000024:2.0:1788642434.349094:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642434.349267:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:13862:x1875527086485888:12345-192.168.202.49@tcp:13:lfs.0 Request processed in 236us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642434.349276:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00080000:0.0:1788642434.353138:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642434.356273:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.356507:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086486016 00000100:00100000:2.0:1788642434.356522:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086486016 00000100:00100000:2.0:1788642434.356910:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:2.0:1788642434.356927:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:13862:x1875527086486016:12345-192.168.202.49@tcp:13:lfs.0 00002000:00000024:2.0:1788642434.356983:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788642434.357157:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:13862:x1875527086486016:12345-192.168.202.49@tcp:13:lfs.0 Request processed in 234us (903us total) trans 0 rc 0/0 00000100:00080000:0.0:1788642434.362576:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788642434.369667:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:3.0:1788642434.640530:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642434.640664:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086486144 00000100:00100000:1.0:1788642434.640689:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086486144 00000100:00100000:1.0:1788642434.640777:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00100000:1.0:1788642434.640789:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+10:13892:x1875527086486144:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788642434.640813:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642434.640848:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfb3ba000/0x4ae1ee156666e55d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9ba6 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642434.640892:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfb3ba000/0x4ae1ee156666e55d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ba6 expref: 11 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642434.640907:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfb3ba000/0x4ae1ee156666e55d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ba6 expref: 11 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642434.640919:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3ba000, rc 0) 00000100:00100000:1.0:1788642434.641007:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+11:13892:x1875527086486144:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 221us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642434.641016:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 92 00000100:00100000:3.0:1788642434.658052:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.672577:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086486272 00000100:00100000:2.0:1788642434.672602:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086486272 00000100:00100000:2.0:1788642434.672801:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 93 00000100:00100000:2.0:1788642434.672816:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc700f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+11:13892:x1875527086486272:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788642434.673363:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc700f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+11:13892:x1875527086486272:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 547us (15323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642434.673380:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 93 00000100:00100000:0.0:1788642434.699193:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.699340:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086486400 00000100:00100000:2.0:1788642434.699353:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086486400 00000100:00100000:2.0:1788642434.699431:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 94 00000100:00100000:2.0:1788642434.699446:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+11:13892:x1875527086486400:12345-192.168.202.49@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788642434.705941:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+11:13892:x1875527086486400:12345-192.168.202.49@tcp:503:mount.lustre.0 Request processed in 6480us (6843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642434.705961:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 94 00000100:00100000:3.0:1788642434.743224:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.743964:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086486528 00000100:00100000:2.0:1788642434.743980:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086486528 00000100:00100000:2.0:1788642434.744060:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 95 00000100:00100000:2.0:1788642434.744074:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+11:13901:x1875527086486528:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788642434.749753:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+11:13901:x1875527086486528:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 5662us (6525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642434.751888:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 95 00000100:00100000:3.0:1788642434.794559:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642434.794894:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086486656 00000100:00100000:1.0:1788642434.794908:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086486656 00000100:00100000:1.0:1788642434.794994:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00100000:1.0:1788642434.795007:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+11:13901:x1875527086486656:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788642434.795484:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+11:13901:x1875527086486656:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 466us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642434.795494:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 96 00000100:00100000:1.0:1788642434.805961:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642434.806227:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086486784 00000100:00100000:0.0:1788642434.806242:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086486784 00000100:00100000:0.0:1788642434.806490:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 97 00000100:00100000:0.0:1788642434.806502:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+11:13892:x1875527086486784:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788642434.806524:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642434.806547:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666e564 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9bd0 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642434.806587:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666e564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9bd0 expref: 12 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642434.806601:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6120200/0x4ae1ee156666e564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9bd0 expref: 12 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642434.806613:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6120200, rc 0) 00000100:00100000:0.0:1788642434.806822:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+12:13892:x1875527086486784:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 321us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642434.806830:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 97 00000100:00100000:1.0:1788642434.813465:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.813600:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086486912 00000100:00100000:2.0:1788642434.813618:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086486912 00000100:00100000:2.0:1788642434.813704:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 98 00000100:00100000:2.0:1788642434.813717:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+12:13892:x1875527086486912:12345-192.168.202.49@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788642434.813754:0:14389:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788642434.813801:0:14389:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788642434.813806:0:14389:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788642434.813810:0:14389:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788642434.813813:0:14389:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788642434.817871:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+12:13892:x1875527086486912:12345-192.168.202.49@tcp:256:mount.lustre.0 Request processed in 4140us (4407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642434.817891:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 98 00000100:00100000:1.0:1788642434.839524:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.840959:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086487040 00000100:00100000:2.0:1788642434.840979:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086487040 00000100:00100000:2.0:1788642434.841341:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 99 00000100:00100000:2.0:1788642434.841356:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+12:13892:x1875527086487040:12345-192.168.202.49@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788642434.841404:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642434.841431:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e56b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9bd7 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642434.841471:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e56b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9bd7 expref: 13 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642434.841485:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e56b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9bd7 expref: 13 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642434.841496:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1c00, rc 0) 00000100:00100000:2.0:1788642434.841586:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13892:x1875527086487040:12345-192.168.202.49@tcp:101:mount.lustre.0 Request processed in 234us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642434.841594:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 99 00000100:00100000:1.0:1788642434.848471:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.848590:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086487168 00000100:00100000:2.0:1788642434.848607:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086487168 00000100:00100000:2.0:1788642434.848702:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00100000:2.0:1788642434.848715:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13892:x1875527086487168:12345-192.168.202.49@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788642434.851581:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13892:x1875527086487168:12345-192.168.202.49@tcp:501:mount.lustre.0 Request processed in 2850us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642434.851601:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 100 00000100:00100000:3.0:1788642434.858332:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642434.858495:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086487296 00000100:00100000:1.0:1788642434.858510:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086487296 00000100:00100000:1.0:1788642434.858590:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 101 00000100:00100000:1.0:1788642434.858603:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13892:x1875527086487296:12345-192.168.202.49@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788642434.859008:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13892:x1875527086487296:12345-192.168.202.49@tcp:503:mount.lustre.0 Request processed in 407us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642434.859019:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 101 00000100:00100000:1.0:1788642434.865891:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.869403:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086487424 00000100:00100000:2.0:1788642434.869426:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086487424 00000100:00100000:2.0:1788642434.869608:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 102 00000100:00100000:2.0:1788642434.869622:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13906:x1875527086487424:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788642434.870057:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13906:x1875527086487424:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 436us (4182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642434.870075:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 102 00000100:00100000:0.0:1788642434.882199:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.884293:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086487552 00000100:00100000:2.0:1788642434.884315:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086487552 00000100:00100000:2.0:1788642434.884418:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 103 00000100:00100000:2.0:1788642434.884431:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13906:x1875527086487552:12345-192.168.202.49@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788642434.884789:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13906:x1875527086487552:12345-192.168.202.49@tcp:502:llog_process_th.0 Request processed in 360us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642434.884798:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 103 00000100:00100000:3.0:1788642434.889202:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642434.889254:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.889329:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086487680 00000100:00100000:2.0:1788642434.889343:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086487680 00000100:00100000:2.0:1788642434.889404:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086488064 00000100:00100000:2.0:1788642434.889407:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086488064 00000100:00100000:3.0:1788642434.889450:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642434.889451:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:2.0:1788642434.889464:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:2361:x1875527086488064:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642434.889483:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642434.889508:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086488320 00000100:00100000:3.0:1788642434.889512:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086488320 00000100:00100000:3.0:1788642434.889537:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086488192 00000100:00100000:3.0:1788642434.889540:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086488192 00000100:00100000:3.0:1788642434.889553:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:3.0:1788642434.889559:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2361:x1875527086488320:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:2.0:1788642434.889577:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:2361:x1875527086488064:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 116us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642434.889585:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:2.0:1788642434.889607:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:2.0:1788642434.889612:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1875527086487680:12345-192.168.202.49@tcp:38:mount.lustre.0 00000100:00100000:3.0:1788642434.889659:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2361:x1875527086488320:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 99us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642434.889666:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:3.0:1788642434.889700:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:3.0:1788642434.889708:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2361:x1875527086488192:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642434.889735:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2361:x1875527086488192:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642434.889741:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00010000:00080000:2.0:1788642434.889821:0:14395:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7f5c02b1-d686-4a38-a2ab-587c307d3c0a@192.168.202.49@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:2.0:1788642434.889879:0:14395:0:(genops.c:1385:class_connect()) connect: client 7f5c02b1-d686-4a38-a2ab-587c307d3c0a, cookie 0x4ae1ee156666e572 00000004:00100000:2.0:1788642434.889921:0:14395:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788642434.891378:0:14395:0:(import.c:65:import_set_state_nolock()) ffff8ddcc802b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788642434.891486:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:2358:x1875527086487680:12345-192.168.202.49@tcp:38:mount.lustre.0 Request processed in 1866us (2391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642434.891512:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:3.0:1788642434.906330:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642434.906391:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642434.906515:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086487936 00000100:00100000:1.0:1788642434.906528:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086487936 00000100:00100000:1.0:1788642434.906642:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086487808 00000100:00100000:1.0:1788642434.906646:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086487808 00000100:00100000:1.0:1788642434.906669:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788642434.906681:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+7:13892:x1875527086487936:12345-192.168.202.49@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788642434.906751:0:16274:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788642434.906886:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+7:13892:x1875527086487936:12345-192.168.202.49@tcp:41:mount.lustre.0 Request processed in 206us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642434.906895:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788642434.906915:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:1.0:1788642434.906922:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:0:x1875527086487808:12345-192.168.202.49@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788642434.906934:0:16274:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788642434.906961:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:0:x1875527086487808:12345-192.168.202.49@tcp:41:mount.lustre.0 Request processed in 40us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642434.906968:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00080000:2.0:1788642434.907622:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642434.913272:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642434.913617:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086488448 00000100:00100000:1.0:1788642434.913640:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086488448 00000100:00100000:1.0:1788642434.913724:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:1.0:1788642434.913736:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:13892:x1875527086488448:12345-192.168.202.49@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788642434.913873:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:13892:x1875527086488448:12345-192.168.202.49@tcp:40:mount.lustre.0 Request processed in 139us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642434.913882:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:1.0:1788642434.917832:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642434.917888:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642434.917948:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642434.918044:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086488576 00000100:00100000:3.0:1788642434.918069:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086488576 00000100:00100000:3.0:1788642434.918158:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086488704 00000100:00100000:3.0:1788642434.918162:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086488704 00000100:00100000:3.0:1788642434.918180:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:3.0:1788642434.918190:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875527086488576:12345-192.168.202.49@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788642434.918236:0:15082:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7f5c02b1-d686-4a38-a2ab-587c307d3c0a@192.168.202.49@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:3.0:1788642434.918278:0:15082:0:(genops.c:1385:class_connect()) connect: client 7f5c02b1-d686-4a38-a2ab-587c307d3c0a, cookie 0x4ae1ee156666e579 00002000:00100000:3.0:1788642434.918296:0:15082:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7f5c02b1-d686-4a38-a2ab-587c307d3c0a/ffff8ddcc533a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788642434.918311:0:15082:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788642434.918674:0:15082:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788642434.918720:0:15082:0:(import.c:65:import_set_state_nolock()) ffff8ddcc533e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788642434.918812:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:2358:x1875527086488576:12345-192.168.202.49@tcp:8:mount.lustre.0 Request processed in 623us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642434.918820:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788642434.919218:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:1.0:1788642434.919227:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875527086488704:12345-192.168.202.49@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788642434.919255:0:15083:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7f5c02b1-d686-4a38-a2ab-587c307d3c0a@192.168.202.49@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:1.0:1788642434.919282:0:15083:0:(genops.c:1385:class_connect()) connect: client 7f5c02b1-d686-4a38-a2ab-587c307d3c0a, cookie 0x4ae1ee156666e580 00002000:00100000:1.0:1788642434.919290:0:15083:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7f5c02b1-d686-4a38-a2ab-587c307d3c0a/ffff8dddfd7cc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788642434.919317:0:15083:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788642434.919591:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086488832 00000100:00100000:2.0:1788642434.919601:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086488832 00002000:00080000:1.0:1788642434.919699:0:15083:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788642434.919723:0:15083:0:(import.c:65:import_set_state_nolock()) ffff8dddfd7c8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788642434.919767:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:2358:x1875527086488704:12345-192.168.202.49@tcp:8:mount.lustre.0 Request processed in 539us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642434.919774:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:2.0:1788642434.927504:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:2.0:1788642434.927538:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:13892:x1875527086488832:12345-192.168.202.49@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788642434.927674:0:14399:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788642434.927799:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:13892:x1875527086488832:12345-192.168.202.49@tcp:33:mount.lustre.0 Request processed in 280us (9981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642434.927808:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:0.0:1788642435.115207:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642435.115296:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086488960 00000100:00100000:2.0:1788642435.115312:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086488960 00000100:00100000:2.0:1788642435.115390:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:2.0:1788642435.115403:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:13927:x1875527086488960:12345-192.168.202.49@tcp:101:mkdir.0 00010000:00010000:2.0:1788642435.115432:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642435.115464:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e587 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c01 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642435.115556:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e58e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642435.115885:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e58e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642435.115910:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e58e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642435.115963:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788642435.115985:0:14395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788642435.116016:0:14395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e58e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642435.116055:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e587 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c01 expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642435.116090:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e58e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c01 expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642435.116241:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:2.0:1788642435.116245:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788642435.116250:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0e00, rc 0) 00000100:00100000:2.0:1788642435.116420:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+7:13927:x1875527086488960:12345-192.168.202.49@tcp:101:mkdir.0 Request processed in 1017us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642435.116428:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00010000:00010000:2.0:1788642435.322485:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642436.346286:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788642436.911760:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of adce0da7-4d4d-46cf-bea0-9514c5720b94 00000001:00100000:2.0:1788642436.911782:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7f5c02b1-d686-4a38-a2ab-587c307d3c0a 00000100:00100000:3.0:1788642437.306655:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107452800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642437.306800:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642437.307012:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107452800 00000100:00100000:1.0:1788642437.307023:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107452800 00000100:00080000:0.0:1788642437.307094:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642437.308461:0:15085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788642437.308488:0:15085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107452800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788642437.308710:0:15085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642437.308890:0:15085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107452800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 414us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642437.308898:0:15085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788642437.308997:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107452800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788642437.370762:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788642437.819846:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107453056:0@lo:400:kworker.0 00000100:00100000:2.0:1788642437.819953:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642437.820019:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107453568:0@lo:400:kworker.0 00000100:00100000:2.0:1788642437.820049:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642437.820081:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788642437.820086:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3318:1875527107452928:0@lo:400:kworker.0 00000100:00100000:2.0:1788642437.820150:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642437.820174:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107453440:0@lo:400:kworker.0 00000100:00100000:2.0:1788642437.820206:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642437.820231:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107453184:0@lo:400:kworker.0 00000100:00100000:2.0:1788642437.820254:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642437.820270:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788642437.820276:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107453312:0@lo:400:kworker.0 00000100:00100000:2.0:1788642437.820296:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642437.820353:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107453056 00000100:00100000:2.0:1788642437.820363:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107453056 00000100:00100000:2.0:1788642437.820421:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107453184 00000100:00100000:2.0:1788642437.820424:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107453184 00000100:00100000:2.0:1788642437.820586:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788642437.820598:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107453056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642437.820663:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107453056:12345-0@lo:400:kworker.0 Request processed in 67us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642437.820671:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788642437.820690:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788642437.820699:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107453184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642437.820732:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107453184:12345-0@lo:400:kworker.0 Request processed in 35us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642437.820738:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788642437.820757:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107453568 00000100:00100000:2.0:1788642437.820761:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107453568 00000100:00100000:2.0:1788642437.820790:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107453440 00000100:00100000:2.0:1788642437.820793:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107453440 00000100:00100000:2.0:1788642437.820803:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107453312 00000100:00100000:2.0:1788642437.820806:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107453312 00000100:00100000:2.0:1788642437.820833:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788642437.820840:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107453568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642437.820881:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875527107453568:12345-0@lo:400:kworker.0 Request processed in 41us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642437.820888:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788642437.820900:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788642437.820906:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107453440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642437.820932:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107453440:12345-0@lo:400:kworker.0 Request processed in 26us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642437.820939:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788642437.820948:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788642437.820954:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107453312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642437.820980:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107453312:12345-0@lo:400:kworker.0 Request processed in 27us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642437.820985:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788642437.821003:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107452928 00000100:00100000:2.0:1788642437.821006:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107452928 00000100:00100000:2.0:1788642437.821033:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788642437.821040:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3318:x1875527107452928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642437.821073:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3318:x1875527107452928:12345-0@lo:400:kworker.0 Request processed in 34us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642437.821079:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788642437.821749:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788642437.821771:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107453696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642437.821837:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642437.821903:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107453696 00000100:00100000:3.0:1788642437.821910:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107453696 00000100:00100000:3.0:1788642437.821955:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788642437.821962:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107453696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642437.822001:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642437.822044:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107453696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642437.822050:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788642437.822128:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788642437.822634:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107453696:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788642437.825675:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788642437.825692:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788642437.825870:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3318:1875527107452928:0@lo:400:kworker.0 00000100:00100000:1.0:1788642437.825871:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107453312:0@lo:400:kworker.0 00000100:00100000:1.0:1788642437.825899:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107453184:0@lo:400:kworker.0 00000100:00100000:0.0:1788642437.825906:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107453440:0@lo:400:kworker.0 00000100:00100000:0.0:1788642437.825924:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107453056:0@lo:400:kworker.0 00000100:00100000:0.0:1788642437.825959:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1875527107453568:0@lo:400:kworker.0 00000001:00100000:2.0:1788642437.865640:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7f5c02b1-d686-4a38-a2ab-587c307d3c0a 00010000:00010000:3.0:1788642438.394451:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788642438.498211:0:6736:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7f5c02b1-d686-4a38-a2ab-587c307d3c0a 00000001:02000400:3.0:1788642438.769784:0:16366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788642439.418330:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642440.345947:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642440.346010:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642440.346036:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642440.346072:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642440.346134:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642440.346165:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642440.346195:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642440.346227:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086489472 00000100:00100000:3.0:1788642440.346258:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086489472 00000100:00100000:3.0:1788642440.346330:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086489728 00000100:00100000:3.0:1788642440.346333:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086489728 00000100:00100000:3.0:1788642440.346352:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086489344 00000100:00100000:3.0:1788642440.346354:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086489344 00000100:00100000:3.0:1788642440.346368:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086489856 00000100:00100000:3.0:1788642440.346370:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086489856 00000100:00100000:3.0:1788642440.346391:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:3.0:1788642440.346401:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2360:x1875527086489472:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642440.346507:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2360:x1875527086489472:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 106us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642440.346516:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:3.0:1788642440.346535:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:3.0:1788642440.346542:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:2360:x1875527086489728:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642440.346568:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:2360:x1875527086489728:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642440.346574:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:3.0:1788642440.346586:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:3.0:1788642440.346592:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2360:x1875527086489344:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642440.346614:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2360:x1875527086489344:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 22us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642440.346620:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:3.0:1788642440.346630:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:3.0:1788642440.346636:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:2360:x1875527086489856:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642440.346657:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:2360:x1875527086489856:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 21us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642440.346670:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:3.0:1788642440.346690:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086489088 00000100:00100000:3.0:1788642440.346694:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086489088 00000100:00100000:3.0:1788642440.346722:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 105 00000100:00100000:3.0:1788642440.346729:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:2360:x1875527086489088:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642440.346755:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:2360:x1875527086489088:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 27us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642440.346761:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 105 00000100:00080000:3.0:1788642440.346801:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788642440.346806:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788642440.347378:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086489216 00000100:00100000:1.0:1788642440.347386:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086489216 00000100:00100000:1.0:1788642440.347449:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086489600 00000100:00100000:1.0:1788642440.347453:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086489600 00000100:00100000:1.0:1788642440.347485:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:1.0:1788642440.347493:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:2360:x1875527086489216:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642440.347544:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:2360:x1875527086489216:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 52us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642440.347564:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:1.0:1788642440.347590:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:1.0:1788642440.347597:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:2360:x1875527086489600:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:1.0:1788642440.347624:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:2360:x1875527086489600:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 28us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642440.347630:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00080000:2.0:1788642440.351966:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788642440.445129:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642441.468601:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642442.426646:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642442.426673:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107453824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788642442.426755:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642442.427160:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107453824 00000100:00100000:3.0:1788642442.427172:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107453824 00000100:00100000:3.0:1788642442.427240:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788642442.427252:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107453824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642442.427295:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642442.427351:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107453824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642442.427360:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788642442.427429:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107453824:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788642442.427545:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788642442.490275:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642442.941034:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788642442.941060:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107453952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788642442.941154:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642442.941489:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107453952 00000100:00100000:3.0:1788642442.941498:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107453952 00000100:00100000:3.0:1788642442.941576:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788642442.941590:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107453952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642442.941630:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642442.941694:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875527107453952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642442.941701:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788642442.941756:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1875527107453952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642442.942499:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107454208:0@lo:400:kworker.0 00000100:00100000:3.0:1788642442.942538:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642442.942638:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642442.942645:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107454336:0@lo:400:kworker.0 00000100:00100000:3.0:1788642442.942675:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642442.942711:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107454208 00000100:00100000:3.0:1788642442.942716:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107454208 00000100:00100000:3.0:1788642442.942750:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788642442.942757:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107454208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642442.942808:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107454208:12345-0@lo:400:kworker.0 Request processed in 51us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642442.942814:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788642442.942835:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107454336 00000100:00100000:3.0:1788642442.942839:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107454336 00000100:00100000:3.0:1788642442.942867:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788642442.942874:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107454336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642442.942904:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875527107454336:12345-0@lo:400:kworker.0 Request processed in 31us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642442.942911:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788642442.942937:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788642442.942943:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107454464:0@lo:400:kworker.0 00000100:00100000:3.0:1788642442.942968:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642442.942998:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788642442.943015:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3317:1875527107454080:0@lo:400:kworker.0 00000100:00100000:0.0:1788642442.943022:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107454464 00000100:00100000:0.0:1788642442.943027:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107454464 00000100:00100000:3.0:1788642442.943052:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642442.943063:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788642442.943072:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107454464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642442.943087:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107454592:0@lo:400:kworker.0 00000100:00100000:0.0:1788642442.943125:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107454464:12345-0@lo:400:kworker.0 Request processed in 55us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642442.943131:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788642442.943147:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642442.944307:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642442.944361:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107454464:0@lo:400:kworker.0 00000100:00100000:3.0:1788642442.944401:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107454080 00000100:00100000:3.0:1788642442.944418:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107454080 00000100:00100000:3.0:1788642442.944457:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788642442.944466:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3317:x1875527107454080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642442.944507:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3317:x1875527107454080:12345-0@lo:400:kworker.0 Request processed in 42us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642442.944514:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788642442.944566:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875527107454336:0@lo:400:kworker.0 00000100:00100000:3.0:1788642442.944579:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107454208:0@lo:400:kworker.0 00000100:00100000:3.0:1788642442.944603:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3317:1875527107454080:0@lo:400:kworker.0 00000100:00100000:2.0:1788642442.946564:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107454592 00000100:00100000:2.0:1788642442.946578:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107454592 00000100:00100000:2.0:1788642442.946638:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788642442.946649:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107454592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642442.946734:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875527107454592:12345-0@lo:400:kworker.0 Request processed in 88us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642442.946742:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788642442.947050:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1875527107454592:0@lo:400:kworker.0 00000100:00080000:1.0:1788642442.948954:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1788642442.978390:0:16514:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd6d0d0360 20000000:00000080:0.0:1788642442.978516:0:16514:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dddc4ee6400 uarg=0000000000000000 20000000:01000000:0.0:1788642442.978609:0:16514:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788642442.978615:0:16514:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788642442.978621:0:16514:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788642442.980858:0:16515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788642442.981330:0:16514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788642442.992830:0:16514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788642442.993444:0:16514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.993469:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddfaa5c000/0x4ae1ee156666e28c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e285 expref: 18 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.993477:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddfaa5de00/0x4ae1ee156666e2d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e2d2 expref: 18 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.993484:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddeffaac00/0x4ae1ee156666e414 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e40d expref: 18 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.993494:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b75 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.993501:0:16514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e56b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9bd7 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.993526:0:16514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.993574:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e56b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9bd7 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.993589:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e56b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9bd7 expref: 12 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642442.993604:0:16514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1875527107454720:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642442.993734:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b75 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.993745:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b75 expref: 12 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642442.993755:0:16514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1875527107454848:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642442.993804:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddeffaac00/0x4ae1ee156666e414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666e40d expref: 18 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.993813:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddeffaac00/0x4ae1ee156666e414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666e40d expref: 18 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642442.993822:0:16514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1875527107454976:0@lo:104: 00000100:00100000:1.0:1788642442.994262:0:16514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788642442.994307:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddfaa5de00/0x4ae1ee156666e2d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666e2d2 expref: 18 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.994327:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddfaa5de00/0x4ae1ee156666e2d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666e2d2 expref: 18 pid: 14387 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642442.994337:0:16514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1875527107455104:0@lo:104: 00000100:00100000:1.0:1788642442.994362:0:16514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642442.994407:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107454976 00000100:00100000:1.0:1788642442.994414:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107454976 00000100:00100000:1.0:1788642442.994456:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107455104 00000100:00100000:1.0:1788642442.994458:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107455104 00000100:00100000:1.0:1788642442.994474:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788642442.994482:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+4:16514:x1875527107454976:12345-0@lo:104: 00010000:00010000:1.0:1788642442.994496:0:14378:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e414 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.994537:0:14378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788642442.994549:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+4:16514:x1875527107454976:12345-0@lo:104: Request processed in 62us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642442.994556:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788642442.994574:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788642442.994580:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+3:16514:x1875527107455104:12345-0@lo:104: 00010000:00010000:1.0:1788642442.994588:0:14378:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e2d9 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.994618:0:14378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788642442.994636:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+3:16514:x1875527107455104:12345-0@lo:104: Request processed in 44us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642442.994643:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788642442.994677:0:16514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dddfaa5c000/0x4ae1ee156666e28c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4ae1ee156666e285 expref: 18 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.994684:0:16514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dddfaa5c000/0x4ae1ee156666e28c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4ae1ee156666e285 expref: 18 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642442.994693:0:16514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1875527107455232:0@lo:104: 00000100:00100000:1.0:1788642442.994717:0:16514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642442.994745:0:14378:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788642442.994754:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107455232 00000100:00100000:1.0:1788642442.994757:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107455232 00000100:00100000:1.0:1788642442.994804:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788642442.994809:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc6595c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+3:16514:x1875527107455232:12345-0@lo:104: 00010000:00010000:1.0:1788642442.994817:0:14378:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e28c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.995075:0:14378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788642442.995082:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc6595c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+3:16514:x1875527107455232:12345-0@lo:104: Request processed in 272us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642442.995088:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788642442.995154:0:16514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5dc9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788642442.995176:0:16514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1875527107454976:0@lo:104: 00000100:00100000:1.0:1788642442.995184:0:16514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1875527107455104:0@lo:104: 00000100:00100000:1.0:1788642442.995190:0:16514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1875527107455232:0@lo:104: 00010000:00010000:0.0:1788642442.995284:0:15570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788642442.995291:0:15570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e414 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995298:0:15570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0800 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642442.995302:0:15570:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666e414 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995323:0:15570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666e414 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642442.995330:0:15570:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666e414 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642442.995337:0:15570:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788642442.995381:0:15570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e414 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995388:0:15570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642442.995411:0:15570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e414 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995418:0:15570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0800/0x4ae1ee156666e40d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e414 expref: -99 pid: 15801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995433:0:15570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788642442.995437:0:15570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e2d9 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995441:0:15570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffab400 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642442.995444:0:15570:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666e2d9 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995451:0:15570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666e2d9 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642442.995456:0:15570:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666e2d9 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642442.995468:0:15570:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788642442.995483:0:15570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e2d9 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995489:0:15570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642442.995495:0:15570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e2d9 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995500:0:15570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddeffab400/0x4ae1ee156666e2d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e2d9 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995509:0:15570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788642442.995512:0:15570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4ae1ee156666e28c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995517:0:15570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0600 already unused, calling callback (ffffffffc1b92c20) 10000000:00010000:0.0:1788642442.995520:0:15570:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4ae1ee156666e28c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995526:0:15570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4ae1ee156666e28c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788642442.995531:0:15570:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4ae1ee156666e28c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642442.995537:0:15570:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788642442.995549:0:15570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e28c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995554:0:15570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788642442.995575:0:15570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e28c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995582:0:15570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.149@tcp lock: ffff8dddfd6e0600/0x4ae1ee156666e285 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4ae1ee156666e28c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.995595:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642442.995597:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642442.995599:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642442.995613:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107455360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642442.995650:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642442.995682:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788642442.995688:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107455488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642442.995708:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642442.995734:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3317:1875527107455616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788642442.995758:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642442.995807:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107455360 00000100:00100000:0.0:1788642442.995812:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107455360 00010000:00010000:0.0:1788642442.995833:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddeffaac00/0x4ae1ee156666e414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e40d expref: 19 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642442.996233:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642442.996241:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642442.996360:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107455488 00000100:00100000:0.0:1788642442.996366:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107455488 00010000:00010000:0.0:1788642442.996383:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddfaa5de00/0x4ae1ee156666e2d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e2d2 expref: 20 pid: 14387 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642442.996395:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107455616 00000100:00100000:0.0:1788642442.996398:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107455616 00010000:00010000:0.0:1788642442.996408:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddfaa5c000/0x4ae1ee156666e28c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e285 expref: 21 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642442.996436:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788642442.996444:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+21:3319:x1875527107455360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642442.996457:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642442.996463:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddeffaac00/0x4ae1ee156666e414 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e40d expref: 21 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.996473:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddeffaac00/0x4ae1ee156666e414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666e40d expref: 21 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.996490:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddeffaac00/0x4ae1ee156666e414 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666e40d expref: 21 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.996505:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642442.996551:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+20:3319:x1875527107455360:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642442.996558:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788642442.996575:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788642442.996581:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3319:x1875527107455488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788642442.996588:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642442.996593:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddfaa5de00/0x4ae1ee156666e2d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e2d2 expref: 19 pid: 14387 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642442.996601:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddfaa5de00/0x4ae1ee156666e2d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666e2d2 expref: 19 pid: 14387 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642442.997789:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107455360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788642442.998083:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642442.998297:0:16514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1875527107454720:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642442.998327:0:14382:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788642442.998336:0:14382:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788642442.998379:0:14381:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788642442.998400:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086489984 00000100:00100000:1.0:1788642442.998406:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086489984 00010000:00010000:1.0:1788642442.998438:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e56b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9bd7 expref: 13 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642442.998460:0:14381:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788642442.998468:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788642442.998476:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddff6cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3317:x1875527107455616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788642442.998487:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642442.998493:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddfaa5c000/0x4ae1ee156666e28c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4ae1ee156666e285 expref: 19 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.998710:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddfaa5c000/0x4ae1ee156666e28c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4ae1ee156666e285 expref: 19 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.998727:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfaa5c000/0x4ae1ee156666e28c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666e285 expref: 19 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.998743:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642442.998806:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddff6cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:3317:x1875527107455616:12345-0@lo:103:ldlm_bl.0 Request processed in 330us (3045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642442.998812:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788642442.998829:0:14381:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788642442.998835:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:1.0:1788642442.998842:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:2359:x1875527086489984:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642442.998851:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642442.998856:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e56b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9bd7 expref: 13 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.998875:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e56b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9bd7 expref: 13 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.998886:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e56b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9bd7 expref: 13 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642442.998895:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642442.998931:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+12:2359:x1875527086489984:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 89us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642442.998937:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:3.0:1788642443.001375:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3317:1875527107455616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788642443.002300:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642443.002354:0:16514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16514:1875527107454848:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642443.002362:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086490112 00000100:00100000:1.0:1788642443.002380:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086490112 00010000:00010000:3.0:1788642443.002392:0:16514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642443.002411:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b75 expref: 12 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642443.002450:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:1.0:1788642443.002460:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+12:2360:x1875527086490112:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642443.002474:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642443.002480:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b75 expref: 12 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642443.002492:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b75 expref: 12 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642443.002510:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e533 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b75 expref: 12 pid: 14390 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642443.002526:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642443.002584:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+11:2360:x1875527086490112:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 126us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642443.002592:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00010000:00010000:0.0:1788642443.004443:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfaa5de00/0x4ae1ee156666e2d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4ae1ee156666e2d2 expref: 17 pid: 14387 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642443.004485:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642443.004493:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642443.006036:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642443.006052:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642443.006060:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642443.006067:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642443.006074:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bb200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642443.006079:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642443.006087:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642443.006281:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642443.006298:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642443.006477:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:3319:x1875527107455488:12345-0@lo:103:ldlm_bl.0 Request processed in 9893us (10764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642443.006488:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788642443.006501:0:16514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642443.006512:0:16514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642443.006518:0:16514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dddfb3bb200/0x4ae1ee156666e595 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642443.006600:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107455488:0@lo:103:ldlm_bl.0 00000040:00080000:0.0:1788642443.130725:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788642443.514322:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788642444.538718:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642444.632407:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642444.632555:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086490240 00000100:00100000:2.0:1788642444.632567:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086490240 00000100:00100000:2.0:1788642444.632636:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 107 00000100:00100000:2.0:1788642444.632649:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+11:13782:x1875527086490240:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642444.632672:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642444.632697:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e59c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c08 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642444.632734:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e59c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c08 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642444.632758:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e0a00/0x4ae1ee156666e59c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c08 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642444.632770:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0a00, rc 0) 00000100:00100000:2.0:1788642444.632843:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+12:13782:x1875527086490240:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 197us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642444.632851:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 107 00000100:00100000:3.0:1788642444.635905:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642444.637216:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086490368 00000100:00100000:0.0:1788642444.637234:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086490368 00000100:00100000:0.0:1788642444.637315:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 108 00000100:00100000:0.0:1788642444.637327:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc52dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+12:13782:x1875527086490368:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642444.637822:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc52dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+12:13782:x1875527086490368:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 493us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642444.637832:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 108 00000100:00100000:3.0:1788642444.641346:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642444.643348:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086490496 00000100:00100000:1.0:1788642444.643366:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086490496 00000100:00100000:1.0:1788642444.643463:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 109 00000100:00100000:1.0:1788642444.643474:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+12:13782:x1875527086490496:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642444.644781:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+12:13782:x1875527086490496:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 1297us (3439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642444.644794:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 109 00000100:00100000:3.0:1788642444.655629:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642444.655743:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086490624 00000100:00100000:2.0:1788642444.655788:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086490624 00000100:00100000:2.0:1788642444.655862:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 110 00000100:00100000:2.0:1788642444.655876:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+12:13782:x1875527086490624:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642444.655902:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642444.655930:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e5a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c0f expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642444.655988:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e5a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c0f expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642444.656001:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e1c00/0x4ae1ee156666e5a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c0f expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642444.656013:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1c00, rc 0) 00000100:00100000:2.0:1788642444.656132:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13782:x1875527086490624:12345-192.168.202.49@tcp:101:ll_cfg_requeue.0 Request processed in 258us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642444.656140:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 110 00000100:00100000:0.0:1788642444.662672:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642444.662780:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086490752 00000100:00100000:3.0:1788642444.662790:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086490752 00000100:00100000:3.0:1788642444.662849:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 111 00000100:00100000:3.0:1788642444.662857:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13782:x1875527086490752:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642444.663312:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13782:x1875527086490752:12345-192.168.202.49@tcp:501:ll_cfg_requeue.0 Request processed in 454us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642444.663319:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 111 00000100:00100000:0.0:1788642444.667132:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642444.667243:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086490880 00000100:00100000:3.0:1788642444.667257:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086490880 00000100:00100000:3.0:1788642444.667325:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 112 00000100:00100000:3.0:1788642444.667337:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13782:x1875527086490880:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788642444.667791:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:13782:x1875527086490880:12345-192.168.202.49@tcp:503:ll_cfg_requeue.0 Request processed in 454us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642444.667801:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 112 10000000:01000000:1.0:1788642444.730208:0:14393:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788642444.730221:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddefa29000 from 10 10000000:01000000:1.0:1788642444.730229:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788642444.730311:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3ba800/0x4ae1ee156666e5aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642444.730326:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfb3ba800/0x4ae1ee156666e5aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642444.730340:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfb3ba800/0x4ae1ee156666e5aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642444.730373:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107455744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788642444.730486:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642444.730574:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc56859c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788642444.730813:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107455744 00000100:00100000:2.0:1788642444.730825:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107455744 00000100:00100000:2.0:1788642444.730893:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788642444.730904:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+16:14393:x1875527107455744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642444.730923:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642444.730941:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e1600/0x4ae1ee156666e5b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e5aa expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642444.730975:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e1600/0x4ae1ee156666e5b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e5aa expref: 17 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642444.731001:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e1600/0x4ae1ee156666e5b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e5aa expref: 17 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642444.731014:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1600, rc 0) 00000100:00100000:2.0:1788642444.731074:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:14393:x1875527107455744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642444.731139:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788642444.731493:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107455744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788642444.731518:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfb3ba800/0x4ae1ee156666e5aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e5b1 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642444.731528:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfb3ba800/0x4ae1ee156666e5aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e5b1 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642444.732134:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107455872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642444.732196:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642444.732245:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc56859c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642444.732343:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107455872 00000100:00100000:0.0:1788642444.732351:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107455872 00000100:00100000:0.0:1788642444.732407:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788642444.732418:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:14393:x1875527107455872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642444.732734:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:14393:x1875527107455872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642444.732742:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788642444.732800:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107455872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642444.732836:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788642444.732880:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642444.732904:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc6386840 going to sleep for 11 seconds 00000100:00100000:0.0:1788642444.732917:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107456000 00000100:00100000:0.0:1788642444.732920:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107456000 00000100:00100000:0.0:1788642444.732937:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788642444.732943:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:14393:x1875527107456000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788642444.733139:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:14393:x1875527107456000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642444.733146:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788642444.733182:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788642444.734012:0:16583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788642444.734088:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788642444.734137:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788642444.734149:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3ba800/0x4ae1ee156666e5aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e5b1 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642444.734162:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfb3ba800/0x4ae1ee156666e5aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e5b1 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788642444.734174:0:14393:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788642444.734177:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ddde4e39000 from 10 10000000:01000000:0.0:1788642444.734179:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788642444.734216:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6120400/0x4ae1ee156666e5b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642444.734224:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddd6120400/0x4ae1ee156666e5b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642444.734247:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddd6120400/0x4ae1ee156666e5b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642444.734270:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788642444.734326:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642444.734351:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc6386cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642444.734367:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107456128 00000100:00100000:0.0:1788642444.734372:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107456128 00000100:00100000:0.0:1788642444.734399:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788642444.734407:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+17:14393:x1875527107456128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788642444.734419:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642444.734435:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddd6121a00/0x4ae1ee156666e5bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e5b8 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642444.734462:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddd6121a00/0x4ae1ee156666e5bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e5b8 expref: 18 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642444.734473:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddd6121a00/0x4ae1ee156666e5bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e5b8 expref: 18 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642444.734483:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121a00, rc 0) 00000100:00100000:0.0:1788642444.734510:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:14393:x1875527107456128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642444.734516:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788642444.734549:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788642444.734562:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddd6120400/0x4ae1ee156666e5b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e5bf expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642444.734577:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddd6120400/0x4ae1ee156666e5b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e5bf expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642444.734624:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642444.734648:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642444.734660:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc6386cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642444.734670:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107456256 00000100:00100000:0.0:1788642444.734673:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107456256 00000100:00100000:0.0:1788642444.734688:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788642444.734693:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:14393:x1875527107456256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642444.734965:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:14393:x1875527107456256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642444.734972:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788642444.735002:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788642444.735028:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfaa6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788642444.735082:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642444.735121:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc6386cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788642444.735131:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107456384 00000100:00100000:0.0:1788642444.735135:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107456384 00000100:00100000:0.0:1788642444.735151:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788642444.735156:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:14393:x1875527107456384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788642444.735298:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:14393:x1875527107456384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642444.735306:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788642444.735348:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfaa6c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788642444.738052:0:16584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788642444.738513:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788642444.738543:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788642444.738558:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddd6120400/0x4ae1ee156666e5b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e5bf expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642444.738573:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddd6120400/0x4ae1ee156666e5b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e5bf expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788642444.738587:0:14393:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788642444.738591:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dddf7f24800 from 10 10000000:01000000:1.0:1788642444.738595:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788642444.738651:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbe00/0x4ae1ee156666e5c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642444.738662:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbe00/0x4ae1ee156666e5c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642444.738677:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbe00/0x4ae1ee156666e5c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642444.738708:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788642444.740892:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642444.740949:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107456512 00000100:00100000:0.0:1788642444.740958:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5685780 going to sleep for 11 seconds 00000100:00100000:2.0:1788642444.740962:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107456512 00000100:00100000:2.0:1788642444.741120:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788642444.741132:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+18:14393:x1875527107456512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788642444.741157:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642444.741182:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666e5cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4ae1ee156666e5c6 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642444.741219:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666e5cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4ae1ee156666e5c6 expref: 19 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642444.741234:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dddfd6e1e00/0x4ae1ee156666e5cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4ae1ee156666e5c6 expref: 19 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642444.741245:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1e00, rc 0) 00000100:00100000:2.0:1788642444.741306:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:14393:x1875527107456512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642444.741313:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788642444.741368:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788642444.741466:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbe00/0x4ae1ee156666e5c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e5cd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642444.741478:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbe00/0x4ae1ee156666e5c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4ae1ee156666e5cd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642444.741595:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788642444.741630:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642444.741663:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5685780 going to sleep for 11 seconds 00000100:00100000:3.0:1788642444.741821:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107456640 00000100:00100000:3.0:1788642444.741826:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107456640 00000100:00100000:3.0:1788642444.741863:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788642444.741871:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:14393:x1875527107456640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788642444.742654:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:14393:x1875527107456640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 777us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642444.742663:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788642444.742806:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788642444.742852:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788642444.742901:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642444.742970:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ddcc6f783c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788642444.747852:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107456768 00000100:00100000:1.0:1788642444.747887:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107456768 00000100:00100000:1.0:1788642444.747973:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788642444.747996:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:14393:x1875527107456768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788642444.748401:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:14393:x1875527107456768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 408us (5497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642444.748410:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788642444.748519:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:228e481e-56eb-4de3-bc1a-1dbb71f0c898:14393:1875527107456768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788642444.753207:0:16585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788642444.760316:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788642444.760385:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.149@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788642444.760402:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbe00/0x4ae1ee156666e5c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e5cd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642444.760418:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.149@tcp lock: ffff8dddfb3bbe00/0x4ae1ee156666e5c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4ae1ee156666e5cd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642445.464775:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642445.464830:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642445.464870:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642445.464900:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642445.464920:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642445.464937:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642445.464995:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642445.465025:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086491136 00000100:00100000:0.0:1788642445.465037:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086491136 00000100:00100000:3.0:1788642445.465050:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086491392 00000100:00100000:3.0:1788642445.465068:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086491392 00000100:00100000:3.0:1788642445.465139:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086491648 00000100:00100000:3.0:1788642445.465143:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086491648 00000100:00100000:0.0:1788642445.465147:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086491520 00000100:00100000:0.0:1788642445.465153:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086491520 00000100:00100000:3.0:1788642445.465168:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086491264 00000100:00100000:3.0:1788642445.465172:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086491264 00000100:00100000:0.0:1788642445.465193:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:3.0:1788642445.465195:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086491776 00000100:00100000:3.0:1788642445.465199:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086491776 00000100:00100000:3.0:1788642445.465217:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:3.0:1788642445.465226:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2361:x1875527086491392:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642445.465339:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2361:x1875527086491392:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 114us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642445.465347:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:3.0:1788642445.465367:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:3.0:1788642445.465373:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:2361:x1875527086491648:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642445.465429:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:2361:x1875527086491648:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 55us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642445.465436:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:3.0:1788642445.465448:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:3.0:1788642445.465455:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2361:x1875527086491264:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642445.465478:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2361:x1875527086491264:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 24us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642445.465484:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:3.0:1788642445.465495:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:3.0:1788642445.465502:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:2361:x1875527086491776:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642445.465526:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:2361:x1875527086491776:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 25us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642445.465544:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:3.0:1788642445.465573:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086491008 00000100:00100000:3.0:1788642445.465576:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086491008 00000100:00100000:3.0:1788642445.465606:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 122 00000100:00100000:3.0:1788642445.465612:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfab66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:2361:x1875527086491008:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642445.465637:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfab66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:2361:x1875527086491008:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 25us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642445.465644:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 122 00000100:00100000:3.0:1788642445.465685:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:3.0:1788642445.465692:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:2361:x1875527086491520:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642445.465721:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:2361:x1875527086491520:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 30us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642445.465734:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:0.0:1788642445.466222:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:2361:x1875527086491136:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:0.0:1788642445.466273:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:2361:x1875527086491136:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 59us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642445.466281:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00080000:0.0:1788642445.466305:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788642445.466310:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642445.466314:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788642445.564534:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788642446.587066:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642447.339884:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642447.339966:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086491904 00000100:00100000:3.0:1788642447.339976:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086491904 00000100:00100000:3.0:1788642447.340081:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:3.0:1788642447.340093:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:14437:x1875527086491904:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788642447.340132:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642447.340163:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e5d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c16 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.340223:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e5db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.340238:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e5db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.340249:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e5db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.340772:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e5e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.340782:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.340790:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788642447.341223:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788642447.341352:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f600/0x4ae1ee156666e5e9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341374:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f600/0x4ae1ee156666e5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341382:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f600/0x4ae1ee156666e5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642447.341409:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788642447.341413:0:14396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642447.341449:0:14396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f600/0x4ae1ee156666e5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341460:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e5db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341466:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e5db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341473:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e5db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341478:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494fe00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642447.341482:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e5db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341490:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e5db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341502:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:3.0:1788642447.341504:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642447.341509:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e5db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341525:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e5db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341539:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e5e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341546:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e5e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341553:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e5e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341558:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494ec00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642447.341562:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e5e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341568:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e5e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341576:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8dddc4dc4800) 00010000:00010000:3.0:1788642447.341579:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642447.341582:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e5e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341588:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e5e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341621:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e5d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c16 expref: 8 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341645:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f600/0x4ae1ee156666e5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c16 expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.341653:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dddc4dc4d00) 00010000:00010000:3.0:1788642447.341656:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788642447.341658:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ddcc494f600, rc 0) 00000100:00100000:3.0:1788642447.341772:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:14437:x1875527086491904:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 1681us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642447.341781:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:2.0:1788642447.361341:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642447.361688:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086492160 00000100:00100000:0.0:1788642447.361698:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086492160 00000100:00100000:0.0:1788642447.361771:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:0.0:1788642447.361782:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:14437:x1875527086492160:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788642447.361811:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642447.361912:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666e5f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c1d expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.361986:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e5f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.362002:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e5f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.362015:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e5f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.362030:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e5fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.362037:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e5fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.362044:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e5fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.363449:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e605 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.363468:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e605 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.363477:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e605 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642447.363490:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788642447.363699:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e5f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.363708:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e5f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.363715:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.363733:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642447.363738:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.363745:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e5f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.363759:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dddc4dc4d00) 00010000:00010000:1.0:1788642447.363762:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642447.363767:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e5f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.363774:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e5f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.363789:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e5fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.363795:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e5fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.363800:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e5fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.364892:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642447.364898:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e5fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.364908:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e5fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.364921:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ddde00fb100) 00010000:00010000:1.0:1788642447.364925:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642447.364928:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e5fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.364935:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e5fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.365512:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666e5f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c1d expref: 10 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.365529:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bb200/0x4ae1ee156666e605 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c1d expref: 9 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.365537:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365fe00) 00010000:00010000:1.0:1788642447.365540:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642447.365543:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3bb200, rc 0) 00000100:00100000:1.0:1788642447.365624:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:14437:x1875527086492160:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 3843us (4291us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788642447.365634:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:0.0:1788642447.382974:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642447.383377:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086492288 00000100:00100000:2.0:1788642447.383387:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086492288 00000100:00100000:2.0:1788642447.383511:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:2.0:1788642447.383522:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:14437:x1875527086492288:12345-192.168.202.49@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788642447.383635:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:14437:x1875527086492288:12345-192.168.202.49@tcp:59:lhsmtool_posix.0 Request processed in 114us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642447.383643:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:0.0:1788642447.423013:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642447.423126:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086492416 00000100:00100000:2.0:1788642447.423136:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086492416 00000100:00100000:2.0:1788642447.423258:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:2.0:1788642447.423270:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:14443:x1875527086492416:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642447.423293:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642447.423327:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e613 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c24 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423398:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e61a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423413:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e61a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423425:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e61a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423441:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e621 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423448:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e621 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423472:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e621 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423656:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e61a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423665:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e61a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423673:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e61a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423679:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642447.423683:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e61a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423691:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e61a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423704:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:2.0:1788642447.423707:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642447.423712:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e61a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423719:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e61a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423743:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e621 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423749:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e621 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423760:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e621 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423765:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:2.0:1788642447.423769:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e621 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423776:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e621 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423784:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dddc98d9d00) 00010000:00010000:2.0:1788642447.423787:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642447.423790:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e621 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.423807:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e621 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.425083:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e613 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c24 expref: 10 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.425116:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:2.0:1788642447.425120:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788642447.425125:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e613 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c24 expref: 10 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.425136:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1800, rc 0) 00000100:00100000:2.0:1788642447.425209:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:14443:x1875527086492416:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1940us (2206us total) trans 0 rc 301/301 00000100:00100000:2.0:1788642447.425229:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:0.0:1788642447.433864:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642447.434195:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086492544 00000100:00100000:1.0:1788642447.434216:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086492544 00000100:00100000:1.0:1788642447.434280:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788642447.434291:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:14443:x1875527086492544:12345-192.168.202.49@tcp:700:lfs.0 00000100:00100000:1.0:1788642447.434397:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:14443:x1875527086492544:12345-192.168.202.49@tcp:700:lfs.0 Request processed in 108us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642447.434405:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:0.0:1788642447.436757:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642447.436865:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086492800 00000100:00100000:1.0:1788642447.436876:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086492800 00000100:00100000:1.0:1788642447.436940:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:1.0:1788642447.436950:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:14443:x1875527086492800:12345-192.168.202.49@tcp:36:lfs.0 00010000:00010000:1.0:1788642447.437008:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642447.437035:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e556 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9b9f expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.437055:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:1.0:1788642447.437060:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788642447.437636:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.437652:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e58e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c01 expref: 5 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.437661:0:14395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.437694:0:14395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e58e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c01 expref: 5 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.437719:0:14395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e58e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c01 expref: 5 pid: 14395 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642447.437751:0:14395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e35500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1875527107456896:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642447.437933:0:14395:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfb4ba900 going to sleep for 11 seconds 00000100:00100000:3.0:1788642447.456083:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642447.459070:0:16516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086492928 00000100:00100000:0.0:1788642447.459091:0:16516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086492928 00010000:00010000:0.0:1788642447.459202:0:16516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e58e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c01 expref: 6 pid: 14395 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642447.459270:0:16516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:0.0:1788642447.459280:0:16516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:2359:x1875527086492928:12345-192.168.202.49@tcp:103:ldlm_bl.0 00000100:00080000:2.0:1788642447.459562:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788642447.459590:0:16516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642447.459599:0:16516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e58e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c01 expref: 6 pid: 14395 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.459614:0:16516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e58e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c01 expref: 6 pid: 14395 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.459635:0:16516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:0.0:1788642447.459641:0:16516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.459651:0:16516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.459658:0:16516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.459680:0:16516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642447.459751:0:16516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:2359:x1875527086492928:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 472us (3677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642447.459759:0:16516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00010000:00010000:1.0:1788642447.462032:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e58e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c01 expref: 5 pid: 14395 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642447.462057:0:14395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e35500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1875527107456896:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642447.462080:0:14395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.462091:0:14395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.462251:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.462925:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e62f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.462941:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e62f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.462952:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e62f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642447.468000:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788642447.468033:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.468042:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.468049:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.468054:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3ba200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642447.468059:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.468066:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.468082:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:1.0:1788642447.468085:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642447.468090:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.468095:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e628 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788642447.468163:0:14395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bab15f3 reply state 00000000b7cc2a02 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e62f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642447.468173:0:14395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788642447.468270:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+10:14443:x1875527086492800:12345-192.168.202.49@tcp:36:lfs.0 Request processed in 31317us (31518us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788642447.468280:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00010000:00010000:0.0:1788642447.482118:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e62f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.482136:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e62f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.482166:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e62f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.482171:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bac00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642447.482176:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e62f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.482184:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e62f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.482200:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dddc365f600) 00010000:00010000:0.0:1788642447.482203:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642447.482208:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e62f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.482214:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e62f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642447.547902:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788642447.547939:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddeff91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107457024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788642447.548023:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642447.548156:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107457024 00000100:00100000:3.0:1788642447.548165:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107457024 00000100:00100000:3.0:1788642447.548226:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788642447.548237:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107457024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642447.548281:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642447.548332:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107457024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642447.548339:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788642447.548437:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788642447.548864:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddeff91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107457024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642447.609706:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642447.610145:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086493056 00000100:00100000:1.0:1788642447.610157:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086493056 00000100:00100000:1.0:1788642447.610220:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 20 00000100:00100000:1.0:1788642447.610231:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:14451:x1875527086493056:12345-192.168.202.49@tcp:101:lctl.0 00010000:00010000:1.0:1788642447.610254:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642447.610281:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e636 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c2b expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.610346:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e63d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.610511:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e63d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.610526:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e63d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642447.610565:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788642447.610569:0:14397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642447.610607:0:14397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e63d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.610631:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e636 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c2b expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.610649:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba600/0x4ae1ee156666e63d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c2b expref: 10 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.610671:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:1.0:1788642447.610674:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788642447.610677:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfb3ba600, rc 0) 00000100:00100000:1.0:1788642447.610796:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+10:14451:x1875527086493056:12345-192.168.202.49@tcp:101:lctl.0 Request processed in 566us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642447.610803:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 20 00010000:00010000:1.0:1788642447.611014:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642447.675287:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642447.675386:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086493184 00000100:00100000:2.0:1788642447.675397:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086493184 00000100:00100000:2.0:1788642447.675458:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:2.0:1788642447.675469:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:14452:x1875527086493184:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642447.675500:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642447.675632:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e644 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c32 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.675698:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e64b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.675712:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e64b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.675734:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e64b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642447.675768:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788642447.675772:0:16274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788642447.675790:0:16274:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e64b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.675880:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e644 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c32 expref: 7 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.675900:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1400/0x4ae1ee156666e64b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c32 expref: 6 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642447.675927:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:2.0:1788642447.675929:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788642447.675933:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1400, rc 0) 00000100:00100000:2.0:1788642447.676029:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:14452:x1875527086493184:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 562us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642447.676036:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 21 00000100:00100000:0.0:1788642447.685844:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642447.686002:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086493312 00000100:00100000:1.0:1788642447.686013:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086493312 00000100:00100000:1.0:1788642447.686074:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:1.0:1788642447.686085:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:14452:x1875527086493312:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642447.686127:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642447.686146:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c39 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686210:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e659 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686226:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e659 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686238:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e659 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686253:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666e660 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686260:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666e660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686278:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666e660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686369:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e667 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686377:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e667 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686384:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e667 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642447.686413:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788642447.686416:0:14397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642447.686433:0:14397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e667 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686444:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e659 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686451:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e659 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686458:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e659 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686464:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfb3bac00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642447.686468:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e659 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686477:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e659 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686495:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:1.0:1788642447.686498:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642447.686503:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e659 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686521:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3bac00/0x4ae1ee156666e659 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686536:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666e660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686542:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666e660 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686548:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666e660 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686554:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddd6121200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642447.686557:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666e660 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686563:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666e660 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686571:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dddc365f100) 00010000:00010000:1.0:1788642447.686573:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642447.686576:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666e660 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686583:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121200/0x4ae1ee156666e660 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686631:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfb3ba200/0x4ae1ee156666e652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c39 expref: 8 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686645:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e667 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c39 expref: 7 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.686652:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dddc365f200) 00010000:00010000:1.0:1788642447.686654:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788642447.686657:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddd6121400, rc 0) 00000100:00100000:1.0:1788642447.686717:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+7:14452:x1875527086493312:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 634us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642447.686734:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 22 00000100:00100000:2.0:1788642447.691662:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642447.692650:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086493568 00000100:00100000:1.0:1788642447.692663:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086493568 00000100:00100000:1.0:1788642447.692793:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:1.0:1788642447.692804:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+7:14452:x1875527086493568:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:1.0:1788642447.692836:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642447.692859:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e66e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c40 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642447.692951:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788642447.693065:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e66e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c40 expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.693079:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:1.0:1788642447.693082:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788642447.693119:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e66e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c40 expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.693134:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaac00, rc 0) 00000100:00100000:1.0:1788642447.693207:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+8:14452:x1875527086493568:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 406us (1555us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788642447.693214:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 23 00000100:00100000:0.0:1788642447.696431:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642447.696731:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086493824 00000100:00100000:1.0:1788642447.696740:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086493824 00000100:00100000:1.0:1788642447.696797:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:1.0:1788642447.696806:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+8:14452:x1875527086493824:12345-192.168.202.49@tcp:36:lfs.0 00010000:00010000:1.0:1788642447.696977:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642447.697006:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddd6121400/0x4ae1ee156666e667 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c39 expref: 8 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.697022:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dddc365f200) 00010000:00010000:1.0:1788642447.697032:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788642447.697052:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e67c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.697072:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e67c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.697080:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e67c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788642447.697279:0:14397:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dfbf90a reply state 000000007178e531 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e67c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642447.697288:0:14397:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788642447.697306:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788642447.697623:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+9:14452:x1875527086493824:12345-192.168.202.49@tcp:36:lfs.0 Request processed in 817us (1201us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788642447.697628:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 24 00000100:00100000:0.0:1788642447.699704:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642447.699784:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086494080 00000100:00100000:3.0:1788642447.699794:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086494080 00000100:00100000:3.0:1788642447.699849:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:3.0:1788642447.699859:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+9:14452:x1875527086494080:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788642447.700042:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+10:14452:x1875527086494080:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 185us (347us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788642447.700065:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00010000:00010000:1.0:1788642447.700695:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e67c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.700704:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e67c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.700709:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e67c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.700714:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffab400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642447.700717:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e67c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.700757:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e67c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.700774:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dddc365f100) 00010000:00010000:1.0:1788642447.700777:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788642447.700783:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e67c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.700790:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e67c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642447.704280:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642447.704581:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086494336 00000100:00100000:0.0:1788642447.704591:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086494336 00000100:00100000:0.0:1788642447.704644:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:0.0:1788642447.704654:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+9:14452:x1875527086494336:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:0.0:1788642447.704677:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642447.704699:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9600/0x4ae1ee156666e683 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c47 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.704798:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e68a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.704918:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e68a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.704933:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e68a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.704951:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9200/0x4ae1ee156666e691 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.704958:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9200/0x4ae1ee156666e691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.704964:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9200/0x4ae1ee156666e691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642447.705076:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788642447.705771:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e68a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.705781:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e68a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.705787:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e68a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.705793:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f8c00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642447.705797:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e68a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.705935:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e68a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.705950:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:0.0:1788642447.705953:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642447.705958:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e68a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.705964:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e68a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.705979:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9200/0x4ae1ee156666e691 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.705985:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9200/0x4ae1ee156666e691 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.705990:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9200/0x4ae1ee156666e691 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.705994:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642447.705997:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9200/0x4ae1ee156666e691 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.706003:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9200/0x4ae1ee156666e691 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.706010:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ddde00fb200) 00010000:00010000:0.0:1788642447.706012:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642447.706015:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9200/0x4ae1ee156666e691 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.706031:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9200/0x4ae1ee156666e691 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.706080:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9600/0x4ae1ee156666e683 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c47 expref: 11 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.706092:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:0.0:1788642447.706094:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788642447.706220:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9600/0x4ae1ee156666e683 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c47 expref: 11 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.706231:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f9600, rc 0) 00000100:00100000:0.0:1788642447.706537:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+10:14452:x1875527086494336:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1881us (2265us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788642447.706546:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 25 00000100:00100000:0.0:1788642447.710166:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642447.710297:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086494464 00000100:00100000:3.0:1788642447.710307:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086494464 00000100:00100000:3.0:1788642447.710505:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:3.0:1788642447.710516:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+10:14452:x1875527086494464:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642447.710539:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642447.710560:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e69f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c4e expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.710642:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e6a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.710658:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.710669:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642447.710693:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788642447.710697:0:14396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642447.710715:0:14396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.710752:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e69f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c4e expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.710772:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c4e expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.710800:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dddc4dc4800) 00010000:00010000:3.0:1788642447.710803:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788642447.710807:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ddcc494ec00, rc 0) 00000100:00100000:3.0:1788642447.710869:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+11:14452:x1875527086494464:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 355us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642447.710877:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 26 00000100:00100000:2.0:1788642447.717024:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642447.717478:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086494592 00000100:00100000:1.0:1788642447.717492:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086494592 00000100:00100000:1.0:1788642447.717560:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:1.0:1788642447.717570:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+11:14452:x1875527086494592:12345-192.168.202.49@tcp:37:lfs.0 00000100:00100000:0.0:1788642447.725151:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+11:14452:x1875527086494592:12345-192.168.202.49@tcp:37:lfs.0 Request processed in 7561us (8117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642447.725166:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:2.0:1788642447.731763:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642447.731846:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086494848 00000100:00100000:3.0:1788642447.731857:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086494848 00000100:00100000:3.0:1788642447.731916:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:3.0:1788642447.731927:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc3f8d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+11:14452:x1875527086494848:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:3.0:1788642447.732226:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc3f8d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+12:14452:x1875527086494848:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 300us (473us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788642447.732233:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:2.0:1788642447.780411:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642447.780569:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086494976 00000100:00100000:1.0:1788642447.780580:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086494976 00000100:00100000:1.0:1788642447.780691:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:1.0:1788642447.780702:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+10:14458:x1875527086494976:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788642447.780732:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642447.780756:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e6ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c55 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.780825:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e6b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.780839:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e6b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.780851:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e6b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.780865:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666e6bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.780872:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666e6bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.780878:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666e6bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.780973:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666e6c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.780982:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666e6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781005:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666e6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642447.781034:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788642447.781037:0:14395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788642447.781087:0:14395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666e6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781140:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e6b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781148:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e6b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781154:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e6b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781160:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaac00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642447.781165:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e6b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781172:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e6b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781183:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:1.0:1788642447.781186:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642447.781190:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e6b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781195:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaac00/0x4ae1ee156666e6b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781220:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666e6bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781226:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666e6bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781232:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666e6bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781237:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaaa00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642447.781240:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666e6bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781246:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666e6bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781254:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dddc365f100) 00010000:00010000:1.0:1788642447.781257:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642447.781260:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666e6bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781333:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaaa00/0x4ae1ee156666e6bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781371:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab400/0x4ae1ee156666e6ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c55 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781386:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa400/0x4ae1ee156666e6c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c55 expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.781403:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dddc4dc4800) 00010000:00010000:1.0:1788642447.781406:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788642447.781409:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaa400, rc 0) 00000100:00100000:1.0:1788642447.781466:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+11:14458:x1875527086494976:12345-192.168.202.49@tcp:101:bash.0 Request processed in 766us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642447.781473:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 27 00000100:00100000:2.0:1788642447.784849:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642447.784938:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086495232 00000100:00100000:1.0:1788642447.784949:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086495232 00000100:00100000:1.0:1788642447.785043:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 28 00000100:00100000:1.0:1788642447.785066:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+11:14458:x1875527086495232:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:1.0:1788642447.785087:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642447.785125:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e6c9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c5c expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.785487:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.785504:0:14397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e6a6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c4e expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.785524:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.785564:0:14397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c4e expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.785579:0:14397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c4e expref: 11 pid: 14396 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642447.785599:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e36300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14397:1875527107457152:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642447.785741:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfb4ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1788642447.788464:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e36300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14397:1875527107457152:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642447.788494:0:14397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642447.791383:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642447.791647:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086495360 00000100:00100000:1.0:1788642447.791658:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086495360 00010000:00010000:1.0:1788642447.791702:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c4e expref: 12 pid: 14396 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642447.791751:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:1.0:1788642447.791761:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+12:2360:x1875527086495360:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642447.791777:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642447.791785:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c4e expref: 12 pid: 14396 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.791799:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c4e expref: 12 pid: 14396 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.791822:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494ec00/0x4ae1ee156666e6a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c4e expref: 12 pid: 14396 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.791840:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dddc4dc4800) 00010000:00010000:1.0:1788642447.791845:0:14382:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.791868:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.791876:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642447.791903:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642447.792000:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+11:2360:x1875527086495360:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 240us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642447.792008:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00010000:00010000:3.0:1788642447.792407:0:14397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.792416:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.792440:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e6d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.792450:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.792458:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.793349:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e6de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.793360:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e6de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.793369:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e6de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642447.793380:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788642447.793407:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.793414:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.793420:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.793426:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffab600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642447.793430:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.793438:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.793450:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dddc4dc4800) 00010000:00010000:3.0:1788642447.793453:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642447.793457:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.793474:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab600/0x4ae1ee156666e6d0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788642447.793488:0:14397:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000af11e59 reply state 00000000a337d254 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642447.793497:0:14397:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788642447.793532:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaae00/0x4ae1ee156666e6c9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c5c expref: 14 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.793546:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e6de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c5c expref: 13 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.793554:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:3.0:1788642447.793556:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788642447.793558:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ddcc494fe00, rc 0) 00000100:00100000:3.0:1788642447.793624:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+14:14458:x1875527086495232:12345-192.168.202.49@tcp:101:bash.0 Request processed in 8571us (8784us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788642447.793633:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 28 00010000:00010000:0.0:1788642447.798382:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e6d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.798400:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e6d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.798408:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e6d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.798433:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494e200 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642447.798438:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e6d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.798446:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e6d7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.798464:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8dddc4dc4600) 00010000:00010000:0.0:1788642447.798467:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642447.798473:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e6d7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.798480:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e200/0x4ae1ee156666e6d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642447.820304:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642447.820417:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086495488 00000100:00100000:0.0:1788642447.820427:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086495488 00000100:00100000:0.0:1788642447.820491:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:0.0:1788642447.820502:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+13:14458:x1875527086495488:12345-192.168.202.49@tcp:101:bash.0 00010000:00010000:0.0:1788642447.820540:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642447.820564:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9200/0x4ae1ee156666e6ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c63 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.820644:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.820660:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.820696:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642447.820769:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788642447.820774:0:16274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788642447.820799:0:16274:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.820812:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.820839:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9200/0x4ae1ee156666e6ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c63 expref: 15 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.820858:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c63 expref: 14 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642447.820867:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:0.0:1788642447.820869:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788642447.820873:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f8c00, rc 0) 00000100:00100000:0.0:1788642447.820947:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+14:14458:x1875527086495488:12345-192.168.202.49@tcp:101:bash.0 Request processed in 447us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642447.820955:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:3.0:1788642447.824147:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642447.828174:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086495744 00000100:00100000:0.0:1788642447.828190:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086495744 00000100:00100000:0.0:1788642447.828253:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:0.0:1788642447.828273:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+14:14458:x1875527086495744:12345-192.168.202.49@tcp:35:bash.0 00000100:00100000:0.0:1788642447.828642:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+15:14458:x1875527086495744:12345-192.168.202.49@tcp:35:bash.0 Request processed in 380us (4507us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788642447.828663:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:2.0:1788642447.952919:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642447.953024:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086496000 00000100:00100000:3.0:1788642447.953037:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086496000 00000100:00100000:3.0:1788642447.953141:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:3.0:1788642447.953155:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+15:14468:x1875527086496000:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:3.0:1788642447.953186:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642447.953212:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e6fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c6a expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642447.953345:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788642447.953499:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e6fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c6a expref: 17 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.953516:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dddc365fc00) 00010000:00010000:3.0:1788642447.953520:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788642447.953525:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e6fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c6a expref: 17 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642447.953557:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ddcc494f000, rc 0) 00000100:00100000:3.0:1788642447.953629:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+16:14468:x1875527086496000:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 478us (724us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788642447.953637:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:3.0:1788642447.961438:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642447.961553:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086496256 00000100:00100000:0.0:1788642447.961569:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086496256 00000100:00100000:0.0:1788642447.961730:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:0.0:1788642447.961743:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+16:14468:x1875527086496256:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:0.0:1788642447.962047:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+17:14468:x1875527086496256:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 306us (624us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788642447.962070:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:0.0:1788642448.027738:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642448.027858:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086496512 00000100:00100000:2.0:1788642448.027869:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086496512 00000100:00100000:2.0:1788642448.027943:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:2.0:1788642448.027955:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfaa6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+17:14471:x1875527086496512:12345-192.168.202.49@tcp:101:lfs.0 00010000:00010000:2.0:1788642448.027981:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642448.028007:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e708 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c71 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.028164:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e70f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.028194:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e70f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.028206:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e70f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788642448.028221:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788642448.029217:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e708 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c71 expref: 20 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.029241:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e70f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c71 expref: 19 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.029250:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:2.0:1788642448.029253:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788642448.029257:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0e00, rc 0) 00000100:00100000:2.0:1788642448.029750:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfaa6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+19:14471:x1875527086496512:12345-192.168.202.49@tcp:101:lfs.0 Request processed in 1796us (2033us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788642448.029759:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 31 00000100:00100000:1.0:1788642448.034845:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642448.034955:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086496768 00000100:00100000:3.0:1788642448.034965:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086496768 00000100:00100000:3.0:1788642448.035079:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:3.0:1788642448.035090:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+19:14471:x1875527086496768:12345-192.168.202.49@tcp:54:lfs.0 00010000:00010000:3.0:1788642448.035195:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e71d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.035211:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e71d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.035223:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e71d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.035274:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e71d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.035282:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e71d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.035290:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e71d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.035296:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494f000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642448.035300:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e71d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.035309:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e71d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.035320:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:3.0:1788642448.035323:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788642448.035327:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e71d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.035334:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e71d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642448.035410:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+19:14471:x1875527086496768:12345-192.168.202.49@tcp:54:lfs.0 Request processed in 321us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642448.035417:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 32 00000100:00100000:3.0:1788642448.038576:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642448.039245:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086496640 00000100:00100000:1.0:1788642448.039255:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086496640 00000100:00100000:1.0:1788642448.039325:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788642448.039335:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+19:2360:x1875527086496640:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642448.039360:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642448.039384:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0e00/0x4ae1ee156666e70f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c71 expref: 19 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.039404:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:1.0:1788642448.039408:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642448.039471:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+18:2360:x1875527086496640:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 138us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642448.039479:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788642448.042919:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642448.043005:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086497024 00000100:00100000:2.0:1788642448.043014:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086497024 00000100:00100000:2.0:1788642448.043075:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:2.0:1788642448.043084:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+18:14471:x1875527086497024:12345-192.168.202.49@tcp:35:lfs.0 00000100:00100000:2.0:1788642448.043760:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+19:14471:x1875527086497024:12345-192.168.202.49@tcp:35:lfs.0 Request processed in 674us (847us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788642448.043768:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:2.0:1788642448.060030:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107457664:0@lo:400:kworker.0 00000100:00100000:2.0:1788642448.060143:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642448.060215:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788642448.060222:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107457536:0@lo:400:kworker.0 00000100:00100000:2.0:1788642448.060247:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788642448.060296:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107457664 00000100:00100000:2.0:1788642448.060304:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107457664 00000100:00100000:2.0:1788642448.060366:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107457536 00000100:00100000:2.0:1788642448.060369:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107457536 00000100:00100000:2.0:1788642448.060388:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788642448.060397:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107457664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642448.060451:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875527107457664:12345-0@lo:400:kworker.0 Request processed in 54us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642448.060459:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788642448.060503:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1875527107457664:0@lo:400:kworker.0 00000100:00100000:2.0:1788642448.060703:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788642448.060710:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107457536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642448.060753:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875527107457536:12345-0@lo:400:kworker.0 Request processed in 44us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642448.060759:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788642448.060781:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875527107457536:0@lo:400:kworker.0 00000100:00100000:3.0:1788642448.060853:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107457280:0@lo:400:kworker.0 00000100:00100000:3.0:1788642448.060900:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642448.060930:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107457792:0@lo:400:kworker.0 00000100:00100000:3.0:1788642448.060953:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642448.060972:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788642448.060977:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfb4b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107457408:0@lo:400:kworker.0 00000100:00100000:3.0:1788642448.061000:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642448.061024:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107457408 00000100:00100000:3.0:1788642448.061028:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107457408 00000100:00100000:3.0:1788642448.061056:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788642448.061062:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107457408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642448.061093:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875527107457408:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642448.061120:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788642448.061148:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1875527107457408:0@lo:400:kworker.0 00000100:00100000:3.0:1788642448.061164:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107457792 00000100:00100000:3.0:1788642448.061167:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107457792 00000100:00100000:3.0:1788642448.061185:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788642448.061190:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107457792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642448.061221:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107457792:12345-0@lo:400:kworker.0 Request processed in 31us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642448.061228:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788642448.061246:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107457792:0@lo:400:kworker.0 00000100:00100000:2.0:1788642448.061421:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107457280 00000100:00100000:2.0:1788642448.061425:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107457280 00000100:00100000:2.0:1788642448.061457:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788642448.061464:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3319:x1875527107457280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788642448.061500:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3319:x1875527107457280:12345-0@lo:400:kworker.0 Request processed in 36us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642448.062220:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788642448.062412:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107457920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788642448.062450:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788642448.062486:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788642448.062491:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788642448.062632:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfb4b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107457280:0@lo:400:kworker.0 00000100:00100000:1.0:1788642448.062796:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107457920 00000100:00100000:1.0:1788642448.062801:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107457920 00000100:00100000:1.0:1788642448.062847:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788642448.062855:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107457920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788642448.062882:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788642448.062922:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107457920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642448.062929:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788642448.063044:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107457920:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788642448.252260:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788642448.351919:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642448.352009:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086497280 00000100:00100000:3.0:1788642448.352020:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086497280 00000100:00100000:3.0:1788642448.352133:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:3.0:1788642448.352144:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+19:14502:x1875527086497280:12345-192.168.202.49@tcp:101:cat.0 00010000:00010000:3.0:1788642448.352182:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642448.352203:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e724 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c78 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.352303:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f200/0x4ae1ee156666e72b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.352317:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f200/0x4ae1ee156666e72b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.352328:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f200/0x4ae1ee156666e72b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642448.352338:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788642448.352499:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e724 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c78 expref: 22 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.352522:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f200/0x4ae1ee156666e72b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c78 expref: 21 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.352531:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:3.0:1788642448.352533:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788642448.352537:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ddcc494f200, rc 0) 00000100:00100000:3.0:1788642448.352605:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+21:14502:x1875527086497280:12345-192.168.202.49@tcp:101:cat.0 Request processed in 462us (697us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788642448.352612:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 33 00000100:00100000:3.0:1788642448.358952:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642448.359065:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086497408 00000100:00100000:1.0:1788642448.359076:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086497408 00000100:00100000:1.0:1788642448.359164:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:1.0:1788642448.359175:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+21:2361:x1875527086497408:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788642448.359191:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788642448.359216:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f200/0x4ae1ee156666e72b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c78 expref: 21 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.359238:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:1.0:1788642448.359244:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788642448.359311:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+20:2361:x1875527086497408:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 138us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642448.359318:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:1.0:1788642448.363163:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642448.363257:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086497664 00000100:00100000:0.0:1788642448.363267:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086497664 00000100:00100000:0.0:1788642448.363325:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:0.0:1788642448.363338:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+20:14502:x1875527086497664:12345-192.168.202.49@tcp:35:cat.0 00000100:00100000:0.0:1788642448.363705:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+21:14502:x1875527086497664:12345-192.168.202.49@tcp:35:cat.0 Request processed in 370us (550us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788642448.363743:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 8 00000100:00100000:3.0:1788642448.439282:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642448.439403:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086497920 00000100:00100000:1.0:1788642448.439413:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086497920 00000100:00100000:1.0:1788642448.439479:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:1.0:1788642448.439489:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+21:14508:x1875527086497920:12345-192.168.202.49@tcp:101:dd.0 00010000:00010000:1.0:1788642448.439523:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642448.439546:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e739 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c7f expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.439691:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666e740 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.439709:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e6de lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c5c expref: 22 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.439728:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c63 expref: 22 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.439737:0:14395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666e740 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.439772:0:14395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c63 expref: 22 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.439786:0:14395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c63 expref: 22 pid: 16274 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642448.439801:0:14395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1875527107458048:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642448.439909:0:14395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e6de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c5c expref: 22 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.439918:0:14395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e6de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c5c expref: 22 pid: 14397 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642448.439926:0:14395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e34000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1875527107458176:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642448.439957:0:14395:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfb4ba600 going to sleep for 11 seconds 00000100:00100000:3.0:1788642448.444704:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642448.444776:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642448.444881:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086498048 00000100:00100000:0.0:1788642448.444891:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086498048 00010000:00010000:0.0:1788642448.444928:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c63 expref: 23 pid: 16274 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642448.444978:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086498176 00000100:00100000:0.0:1788642448.444982:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086498176 00010000:00010000:0.0:1788642448.444995:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e6de lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c5c expref: 24 pid: 14397 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642448.445033:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:0.0:1788642448.445042:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddff6cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:2359:x1875527086498048:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642448.445059:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642448.445065:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c63 expref: 24 pid: 16274 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.445077:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c63 expref: 24 pid: 16274 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.445123:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:0.0:1788642448.445129:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666e740 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.445138:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666e740 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.445145:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642448.445191:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddff6cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:2359:x1875527086498048:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 151us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642448.445200:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:0.0:1788642448.445245:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:0.0:1788642448.445251:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+23:2360:x1875527086498176:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642448.445264:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642448.445269:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e6de lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c5c expref: 23 pid: 14397 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.445279:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e6de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c5c expref: 23 pid: 14397 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.445290:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:0.0:1788642448.445294:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666e740 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.445302:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666e740 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.445309:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666e740 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.445325:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642448.445341:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+23:2360:x1875527086498176:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 90us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642448.445361:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00010000:00010000:1.0:1788642448.445928:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8c00/0x4ae1ee156666e6f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c63 expref: 22 pid: 16274 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642448.445946:0:14395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1875527107458048:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642448.445958:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fe00/0x4ae1ee156666e6de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c5c expref: 21 pid: 14397 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642448.445969:0:14395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e34000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1875527107458176:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642448.445994:0:14395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666e740 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.446004:0:14395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666e740 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.446008:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666e740 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642448.446027:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788642448.446230:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa000/0x4ae1ee156666e739 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c7f expref: 22 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.446246:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffab000/0x4ae1ee156666e740 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c7f expref: 21 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.446255:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:1.0:1788642448.446258:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788642448.446261:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffab000, rc 0) 00000100:00100000:1.0:1788642448.446320:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+21:14508:x1875527086497920:12345-192.168.202.49@tcp:101:dd.0 Request processed in 6833us (7050us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788642448.446328:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 34 00000100:00100000:3.0:1788642448.450776:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642448.450934:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086498432 00000100:00100000:2.0:1788642448.450945:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086498432 00000100:00100000:2.0:1788642448.450998:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 35 00000100:00100000:2.0:1788642448.451008:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+21:14508:x1875527086498432:12345-192.168.202.49@tcp:36:dd.0 00010000:00010000:2.0:1788642448.451279:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e74e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.451296:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e74e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.451307:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e74e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788642448.451388:0:16274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788642448.451416:0:16274:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fedede6 reply state 00000000dad78be5 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e74e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642448.451425:0:16274:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788642448.451562:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:14508:x1875527086498432:12345-192.168.202.49@tcp:36:dd.0 Request processed in 554us (795us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788642448.451570:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 35 00000020:00080000:2.0:1788642448.451575:0:16274:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788642448.456128:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:1.0:1788642448.456199:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e74e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.456212:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e74e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.456220:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e74e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.456225:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642448.456229:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e74e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.456238:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e74e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.456254:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:1.0:1788642448.456257:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642448.456262:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e74e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642448.456268:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0000/0x4ae1ee156666e74e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642448.456340:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086498560 00000100:00100000:0.0:1788642448.456366:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086498560 00000100:00100000:0.0:1788642448.456424:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:0.0:1788642448.456434:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+23:14508:x1875527086498560:12345-192.168.202.49@tcp:101:dd.0 00010000:00010000:0.0:1788642448.456454:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642448.456473:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e755 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c86 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.456557:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e755 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c86 expref: 24 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.456571:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e755 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c86 expref: 24 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.456589:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:0.0:1788642448.456591:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788642448.456594:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f8600, rc 0) 00000100:00100000:0.0:1788642448.457649:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:14508:x1875527086498560:12345-192.168.202.49@tcp:101:dd.0 Request processed in 1210us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642448.457659:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 36 00000100:00100000:3.0:1788642448.476559:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642448.476663:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086498816 00000100:00100000:0.0:1788642448.476673:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086498816 00000100:00100000:0.0:1788642448.476773:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:0.0:1788642448.476784:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:14508:x1875527086498816:12345-192.168.202.49@tcp:103:dd.0 00010000:00010000:0.0:1788642448.476802:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642448.476827:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e755 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c86 expref: 24 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642448.476848:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:0.0:1788642448.476853:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642448.477018:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+23:14508:x1875527086498816:12345-192.168.202.49@tcp:103:dd.0 Request processed in 236us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642448.477026:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:2.0:1788642448.479994:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642448.480092:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086498944 00000100:00100000:3.0:1788642448.480134:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086498944 00000100:00100000:3.0:1788642448.480190:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:3.0:1788642448.480200:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+23:14508:x1875527086498944:12345-192.168.202.49@tcp:58:dd.0 00010000:00010000:3.0:1788642448.480307:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e75c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.480326:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e75c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642448.480337:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e75c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788642448.481847:0:16274:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788642448.482003:0:16274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788642448.482087:0:16274:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788642448.482230:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+23:14508:x1875527086498944:12345-192.168.202.49@tcp:58:dd.0 Request processed in 2025us (2240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642448.482243:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 37 00000100:00100000:1.0:1788642448.486785:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642448.486891:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086499072 00000100:00100000:2.0:1788642448.486919:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086499072 00000100:00100000:2.0:1788642448.486988:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 38 00000100:00100000:2.0:1788642448.486997:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+23:14508:x1875527086499072:12345-192.168.202.49@tcp:101:dd.0 00010000:00010000:2.0:1788642448.487021:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642448.487040:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e763 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c8d expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.487134:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e75c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.487146:0:14395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e763 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c8d expref: 24 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.487165:0:14395:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e75c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.487179:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e763 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c8d expref: 24 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.487193:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:2.0:1788642448.487196:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788642448.487200:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e763 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c8d expref: 24 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642448.487207:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e1800, rc 0) 00000100:00100000:2.0:1788642448.487364:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:14508:x1875527086499072:12345-192.168.202.49@tcp:101:dd.0 Request processed in 367us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642448.487372:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 38 00010000:00010000:3.0:1788642448.634286:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788642449.274786:0:14427:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788642449.274917:0:14427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642449.274960:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788642449.274967:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788642449.275088:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14427:1875527107458304:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788642449.275924:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfb145cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642449.281175:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14427:1875527107458304:192.168.202.49@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788642449.289507:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642449.290527:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086499200 00000100:00100000:1.0:1788642449.290538:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086499200 00000100:00100000:1.0:1788642449.290607:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788642449.290618:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:14510:x1875527086499200:12345-192.168.202.49@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788642449.290915:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:14510:x1875527086499200:12345-192.168.202.49@tcp:900:lhsmtool_posix.0 Request processed in 133us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642449.290924:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00080000:0.0:1788642449.292506:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788642449.296188:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.297309:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086499328 00000100:00100000:0.0:1788642449.297320:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086499328 00000100:00100000:0.0:1788642449.297426:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:0.0:1788642449.297435:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:14510:x1875527086499328:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788642449.297463:0:14397:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788642449.297565:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:14510:x1875527086499328:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 132us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642449.297571:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 39 00000100:00100000:3.0:1788642449.306571:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.306931:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086499456 00000100:00100000:0.0:1788642449.306941:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086499456 00000100:00100000:0.0:1788642449.307071:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:0.0:1788642449.307082:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:14510:x1875527086499456:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788642449.307217:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e76a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307251:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e76a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307264:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e76a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307281:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e771 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307287:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e771 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307294:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e771 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307327:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e778 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307336:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307343:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788642449.307380:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788642449.307385:0:14396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788642449.307400:0:14396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307410:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e76a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307417:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e76a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307425:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e76a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307430:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642449.307434:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e76a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307443:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e76a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307455:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365fe00) 00010000:00010000:0.0:1788642449.307465:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642449.307470:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e76a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307476:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e76a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307491:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e771 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307503:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e771 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307510:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e771 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307515:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f8000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642449.307518:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e771 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307523:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e771 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307531:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8ddde00fb600) 00010000:00010000:0.0:1788642449.307533:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642449.307536:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e771 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307541:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e771 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307554:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307565:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e778 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307571:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e778 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307575:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9c00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642449.307579:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e778 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307585:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e778 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307592:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:0.0:1788642449.307594:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788642449.307597:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e778 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.307604:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e778 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642449.307678:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:14510:x1875527086499456:12345-192.168.202.49@tcp:34:lhsmtool_posix.0 Request processed in 597us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642449.307686:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 40 00000100:00100000:3.0:1788642449.315006:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.321614:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086499712 00000100:00100000:0.0:1788642449.321629:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086499712 00000100:00100000:1.0:1788642449.326942:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:1.0:1788642449.326957:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+24:14510:x1875527086499712:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788642449.326983:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788642449.327008:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666e77f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c94 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.327147:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666e786 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.327161:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666e786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.327173:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666e786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788642449.327183:0:16274:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788642449.327293:0:16274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666e786 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.327301:0:16274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666e786 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.327308:0:16274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666e786 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.327330:0:16274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffabe00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642449.327346:0:16274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666e786 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.327355:0:16274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666e786 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.327370:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:1.0:1788642449.327373:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788642449.327378:0:16274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666e786 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.327385:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffabe00/0x4ae1ee156666e786 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.327431:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666e77f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c94 expref: 26 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.327442:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dddc365fe00) 00010000:00010000:1.0:1788642449.327444:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788642449.327448:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddeffaa200/0x4ae1ee156666e77f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c94 expref: 26 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.327458:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddeffaa200, rc 0) 00000100:00100000:1.0:1788642449.327547:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+25:14510:x1875527086499712:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 593us (12551us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788642449.327554:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 41 00000100:00100000:1.0:1788642449.337961:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.338077:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086499840 00000100:00100000:3.0:1788642449.338087:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086499840 00000100:00100000:3.0:1788642449.338180:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:3.0:1788642449.338189:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+25:14510:x1875527086499840:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788642449.338455:0:14395:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788642449.338574:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+25:14510:x1875527086499840:12345-192.168.202.49@tcp:53:lhsmtool_posix.0 Request processed in 385us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642449.338582:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 42 00000100:00100000:3.0:1788642449.345925:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.346090:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086500096 00000100:00100000:0.0:1788642449.346150:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086500096 00000100:00100000:0.0:1788642449.346208:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:0.0:1788642449.346218:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+25:14510:x1875527086500096:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788642449.346268:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642449.346288:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e794 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9c9b expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788642449.347046:0:14397:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:0.0:1788642449.347054:0:14397:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788642449.347124:0:14397:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788642449.347692:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e79b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.347717:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e79b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.347728:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e79b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.348022:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e794 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c9b expref: 28 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.348042:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e79b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c9b expref: 27 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.348051:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ddde00fb600) 00010000:00010000:0.0:1788642449.348054:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788642449.348058:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f8000, rc 0) 00000100:00100000:0.0:1788642449.348273:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+27:14510:x1875527086500096:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 2055us (2360us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788642449.348282:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 43 00000100:00100000:1.0:1788642449.353603:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.353725:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086500352 00000100:00100000:3.0:1788642449.353736:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086500352 00000100:00100000:3.0:1788642449.353880:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:3.0:1788642449.353893:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+27:14510:x1875527086500352:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788642449.353959:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642449.353991:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8000/0x4ae1ee156666e79b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c9b expref: 27 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354020:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ddde00fb600) 00010000:00010000:3.0:1788642449.354032:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788642449.354222:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f400/0x4ae1ee156666e7a9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354238:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f400/0x4ae1ee156666e7a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354250:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f400/0x4ae1ee156666e7a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354267:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4e8390aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354288:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e8390aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354296:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e8390aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354422:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f400/0x4ae1ee156666e7a9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354430:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f400/0x4ae1ee156666e7a9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354508:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f400/0x4ae1ee156666e7a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354513:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494f400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642449.354518:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f400/0x4ae1ee156666e7a9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354525:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f400/0x4ae1ee156666e7a9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354534:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dddc4dc4800) 00010000:00010000:3.0:1788642449.354537:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642449.354541:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f400/0x4ae1ee156666e7a9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354548:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f400/0x4ae1ee156666e7a9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354561:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e8390aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354573:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7b0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e8390aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354579:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e8390aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354585:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494e600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642449.354588:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e8390aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354594:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7b0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e8390aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354602:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4e8390aa (ffff8dddc4dc4300) 00010000:00010000:3.0:1788642449.354605:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642449.354608:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7b0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4e8390aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.354614:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7b0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4e8390aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642449.354776:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+26:14510:x1875527086500352:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 884us (1183us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788642449.354784:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 44 00000100:00100000:1.0:1788642449.357164:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.358593:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086500480 00000100:00100000:3.0:1788642449.358606:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086500480 00000100:00100000:3.0:1788642449.358663:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:3.0:1788642449.358672:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+26:14510:x1875527086500480:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788642449.358692:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642449.358736:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e7b7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9ca2 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.358771:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e400/0x4ae1ee156666e7be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.358785:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e400/0x4ae1ee156666e7be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.358797:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e400/0x4ae1ee156666e7be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.358886:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e7b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ca2 expref: 28 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.358905:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e400/0x4ae1ee156666e7be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ca2 expref: 27 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.358914:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dddc4dc4700) 00010000:00010000:3.0:1788642449.358918:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788642449.358922:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ddcc494e400, rc 0) 00000100:00100000:3.0:1788642449.358989:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+27:14510:x1875527086500480:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 318us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642449.358995:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 45 00000100:00100000:0.0:1788642449.361947:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642449.362214:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086500736 00000100:00100000:2.0:1788642449.362224:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086500736 00000100:00100000:2.0:1788642449.362382:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:2.0:1788642449.362393:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+27:14510:x1875527086500736:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788642449.362474:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666e7c5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.362493:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666e7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.362505:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666e7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788642449.364198:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788642449.364216:0:14396:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 536825116972ns, next at 537825113462ns, rc = 0 00000004:00010000:3.0:1788642449.364416:0:14396:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1ee1de7 reply state 00000000a1ca4248 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666e7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642449.364427:0:14396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788642449.364562:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+29:14510:x1875527086500736:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 2168us (2621us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788642449.364570:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 46 00000100:00100000:1.0:1788642449.366776:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00010000:00010000:0.0:1788642449.366861:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666e7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.366873:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666e7c5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.366881:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666e7c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.366886:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:0.0:1788642449.366892:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666e7c5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.366900:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666e7c5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.366917:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dddc4dc4700) 00010000:00010000:0.0:1788642449.366920:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788642449.366926:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666e7c5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.366932:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1000/0x4ae1ee156666e7c5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642449.367039:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086500864 00000100:00100000:3.0:1788642449.367048:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086500864 00000100:00100000:0.0:1788642449.367215:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:0.0:1788642449.367228:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+28:14510:x1875527086500864:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788642449.367249:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788642449.367265:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e7cc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9ca9 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.367324:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e7cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ca9 expref: 29 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.367449:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e7cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ca9 expref: 29 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.367470:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dddc4dc4700) 00010000:00010000:0.0:1788642449.367473:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788642449.367476:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dde021f9c00, rc 0) 00000100:00100000:0.0:1788642449.367539:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+29:14510:x1875527086500864:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 315us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642449.367547:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 47 00000100:00100000:1.0:1788642449.369694:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.369754:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086500992 00000100:00100000:3.0:1788642449.369763:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086500992 00000100:00100000:3.0:1788642449.369838:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:3.0:1788642449.369848:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2360:x1875527086500992:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788642449.370072:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642449.370376:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:2360:x1875527086500992:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 529us (688us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788642449.370385:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 12 00000100:00100000:3.0:1788642449.372531:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.372574:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086501248 00000100:00100000:0.0:1788642449.372583:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086501248 00000100:00100000:0.0:1788642449.372641:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:0.0:1788642449.372652:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+29:14510:x1875527086501248:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788642449.372884:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+30:14510:x1875527086501248:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 232us (356us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788642449.372891:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 9 00000100:00100000:1.0:1788642449.376245:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.376317:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086501504 00000100:00100000:3.0:1788642449.376326:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086501504 00000100:00100000:3.0:1788642449.376385:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:3.0:1788642449.376394:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+30:14510:x1875527086501504:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788642449.376501:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+30:14510:x1875527086501504:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642449.376508:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 48 00000100:00100000:1.0:1788642449.381488:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.381560:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086501632 00000100:00100000:3.0:1788642449.381568:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086501632 00000100:00100000:3.0:1788642449.381629:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:3.0:1788642449.381639:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+30:14510:x1875527086501632:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788642449.381663:0:16274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642449.381686:0:16274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e7d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9cb0 expref: -99 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.381778:0:16274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.381790:0:16274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.381798:0:16274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788642449.381827:0:16274:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788642449.381844:0:16274:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.381876:0:16274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e7d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cb0 expref: 32 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.381896:0:16274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cb0 expref: 31 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.381904:0:16274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dddc4dc4700) 00010000:00010000:3.0:1788642449.381907:0:16274:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788642449.381910:0:16274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ddcc494e600, rc 0) 00000100:00100000:3.0:1788642449.381972:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+31:14510:x1875527086501632:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 335us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642449.381979:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 49 00000100:00100000:1.0:1788642449.385622:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.385747:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086501760 00000100:00100000:3.0:1788642449.385756:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086501760 00000100:00100000:3.0:1788642449.385833:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:3.0:1788642449.385860:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+6:2359:x1875527086501760:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788642449.385878:0:15082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788642449.385896:0:15082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e7e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9cb7 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788642449.385919:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c8491, blocks: 0x1 00010000:00010000:3.0:1788642449.385937:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=536s v=(0 0) 00010000:00010000:3.0:1788642449.385941:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642449.385948:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e7e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cb7 expref: 7 pid: 15082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.385961:0:15082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e7e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cb7 expref: 7 pid: 15082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.385971:0:15082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ddcc494f400, rc 0) 00000100:00100000:3.0:1788642449.386028:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:2359:x1875527086501760:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 171us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642449.386033:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:1.0:1788642449.389577:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.389685:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086502016 00000100:00100000:3.0:1788642449.389694:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086502016 00000100:00100000:3.0:1788642449.389790:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:3.0:1788642449.389798:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+31:14510:x1875527086502016:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788642449.389884:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+31:14510:x1875527086502016:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 86us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642449.389895:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 50 00000100:00100000:2.0:1788642449.392532:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.392580:0:16274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086502144 00000100:00100000:3.0:1788642449.392589:0:16274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086502144 00000100:00100000:3.0:1788642449.392645:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:3.0:1788642449.392655:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+31:14510:x1875527086502144:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788642449.457938:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1788642449.457958:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000004:00080000:1.0:1788642449.457980:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788642449.458009:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788642449.458219:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddc4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107458432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788642449.458411:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642449.458492:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107458432 00000100:00100000:1.0:1788642449.458498:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107458432 00000100:00100000:1.0:1788642449.458545:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788642449.458554:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107458432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788642449.458693:0:15080:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788642449.458697:0:15080:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788642449.458699:0:15080:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788642449.458710:0:15080:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788642449 -> 1788642449 00002000:00010000:1.0:1788642449.458713:0:15080:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788642449.458756:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1875527107458432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (345us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788642449.458764:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788642449.458931:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788642449.458971:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dddc4e34380/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788642449.458990:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddc4e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107458432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788642449.459428:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+14:14510:x1875527086502144:12345-192.168.202.49@tcp:44:lhsmtool_posix.0 Request processed in 66771us (66898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642449.459437:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 51 00000100:00100000:1.0:1788642449.463733:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.463985:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086502272 00000100:00100000:3.0:1788642449.463995:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086502272 00000100:00100000:3.0:1788642449.464077:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:3.0:1788642449.464086:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc4e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:2359:x1875527086502272:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788642449.464220:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc4e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:2359:x1875527086502272:12345-192.168.202.49@tcp:16:lhsmtool_posix.0 Request processed in 134us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642449.464228:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:1.0:1788642449.468017:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.468415:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086502528 00000100:00100000:0.0:1788642449.468427:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086502528 00000100:00100000:0.0:1788642449.468529:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:0.0:1788642449.468540:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfb40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+14:14510:x1875527086502528:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788642449.468609:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642449.468636:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494e600/0x4ae1ee156666e7da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cb0 expref: 14 pid: 16274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.468657:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dddc4dc4700) 00010000:00010000:0.0:1788642449.468662:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788642449.468693:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e7e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.468715:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.468725:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788642449.468992:0:14396:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d82f3c24 reply state 000000008da3986b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642449.469002:0:14396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788642449.469372:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfb40df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+15:14510:x1875527086502528:12345-192.168.202.49@tcp:36:lhsmtool_posix.0 Request processed in 833us (1364us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788642449.469381:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 52 00000100:00100000:3.0:1788642449.473562:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642449.473731:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086502656 00000100:00100000:2.0:1788642449.473740:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086502656 00000100:00100000:2.0:1788642449.473809:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:2.0:1788642449.473820:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:14510:x1875527086502656:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788642449.473839:0:15083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788642449.473856:0:15083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb7867eb9ad3a9cbe expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.473888:0:15083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e7e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cb7 expref: 8 pid: 15082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.473909:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642449.473913:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642449.473919:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cbe expref: 8 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.473951:0:15083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e7e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cb7 expref: 8 pid: 15082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.473965:0:15083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e7e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cb7 expref: 8 pid: 15082 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642449.473979:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddef17ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15083:1875527107458560:192.168.202.49@tcp:104: 00000100:00100000:2.0:1788642449.474054:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddfb145a80 going to sleep for 11 seconds 00010000:00010000:1.0:1788642449.475087:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.475221:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e7e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.475229:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e7e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.475302:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9400 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642449.475308:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e7e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.475316:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e7e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.475385:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dddc4dc4700) 00010000:00010000:1.0:1788642449.475389:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788642449.475395:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e7e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.475402:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9400/0x4ae1ee156666e7e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642449.476867:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddef17ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15083:1875527107458560:192.168.202.49@tcp:104: 00010000:00010000:1.0:1788642449.476904:0:15083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cbe expref: 8 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.476944:0:15083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dddfd6e0600, rc 0) 00000100:00100000:1.0:1788642449.477044:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+8:14510:x1875527086502656:12345-192.168.202.49@tcp:101:lhsmtool_posix.0 Request processed in 3224us (3490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788642449.477053:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:3.0:1788642449.478178:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.478518:0:16516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086502784 00000100:00100000:0.0:1788642449.478527:0:16516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086502784 00010000:00010000:0.0:1788642449.478567:0:16516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e7e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cb7 expref: 8 pid: 15082 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642449.478599:0:16516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:0.0:1788642449.478608:0:16516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+8:2360:x1875527086502784:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642449.478633:0:16516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642449.478656:0:16516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e7e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cb7 expref: 8 pid: 15082 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.478669:0:16516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e7e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cb7 expref: 8 pid: 15082 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.478689:0:16516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e7e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cb7 expref: 8 pid: 15082 timeout: 636 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.478712:0:16516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642449.478717:0:16516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642449.478724:0:16516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cbe expref: 7 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.478734:0:16516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cbe expref: 7 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.478768:0:16516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cbe expref: 7 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642449.478791:0:16516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16516:1875527107458688:192.168.202.49@tcp:105: 00000100:00100000:0.0:1788642449.478861:0:16516:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5dc9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788642449.482018:0:16516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16516:1875527107458688:192.168.202.49@tcp:105: 00010000:00010000:0.0:1788642449.482041:0:16516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788642449.482244:0:16516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:2360:x1875527086502784:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 3628us (4061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642449.482255:0:16516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 13 00000100:00100000:1.0:1788642449.486901:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.486964:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086502912 00000100:00100000:3.0:1788642449.486973:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086502912 00000100:00100000:3.0:1788642449.487020:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:3.0:1788642449.487027:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+7:2359:x1875527086502912:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788642449.487438:0:15082:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788642449.487441:0:15082:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788642448 00002000:00010000:3.0:1788642449.487443:0:15082:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788642447 00002000:00010000:3.0:1788642449.487444:0:15082:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788642449 -> 1788642448 00002000:00010000:3.0:1788642449.487446:0:15082:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788642449.487497:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+8:2359:x1875527086502912:12345-192.168.202.49@tcp:2:lhsmtool_posix.0 Request processed in 469us (605us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788642449.487505:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:2.0:1788642449.493874:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642449.495071:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086503040 00000100:00100000:1.0:1788642449.495082:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086503040 00000100:00100000:1.0:1788642449.495160:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:1.0:1788642449.495171:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+8:2360:x1875527086503040:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788642449.495219:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.495239:0:15083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cbe expref: 8 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.495247:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642449.495252:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788642449.495256:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.495292:0:15083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cbe expref: 8 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.495306:0:15083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cbe expref: 8 pid: 15083 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642449.495468:0:15083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15083:1875527107458816:192.168.202.49@tcp:104: 00000100:00100000:1.0:1788642449.495573:0:15083:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc8c7c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788642449.499688:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.499751:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086503168 00000100:00100000:0.0:1788642449.499760:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086503168 00000100:00100000:2.0:1788642449.499869:0:15083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15083:1875527107458816:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642449.499870:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cbe expref: 9 pid: 15083 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.499891:0:15083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642449.499911:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:0.0:1788642449.499921:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:2360:x1875527086503168:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788642449.499936:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788642449.499958:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cbe expref: 9 pid: 15083 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.499971:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cbe expref: 9 pid: 15083 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.499990:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006601c9ff/0x4ae1ee156666e7ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9cbe expref: 9 pid: 15083 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.500003:0:14380:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788642449.500006:0:14380:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788642449.500010:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.500016:0:14380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.500048:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788642449.500079:0:15083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.500087:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.500162:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.500170:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.500178:0:15083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.500185:0:15083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaaa00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642449.500190:0:15083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.500199:0:15083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.500212:0:15083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.500219:0:15083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000384caf78/0x4ae1ee156666e7f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642449.500622:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+8:2360:x1875527086503040:12345-192.168.202.49@tcp:1:lhsmtool_posix.0 Request processed in 5451us (6756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642449.500641:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:0.0:1788642449.500650:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+8:2360:x1875527086503168:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 731us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788642449.500656:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 14 00000100:00100000:1.0:1788642449.505048:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.505092:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086503424 00000100:00100000:0.0:1788642449.505327:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086503424 00000100:00100000:0.0:1788642449.505442:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 53 00000100:00100000:0.0:1788642449.505452:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+14:14510:x1875527086503424:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788642449.505600:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e7fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.505619:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e7fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.505631:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e7fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.505946:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.505959:0:14397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e7cc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ca9 expref: 15 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.505968:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.506001:0:14397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e7cc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ca9 expref: 15 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.506028:0:14397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e7cc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ca9 expref: 15 pid: 14397 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642449.506042:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14397:1875527107458944:192.168.202.49@tcp:104: 00000100:00100000:0.0:1788642449.506524:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5dc9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788642449.511533:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.511744:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086503552 00000100:00100000:3.0:1788642449.511766:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086503552 00010000:00010000:3.0:1788642449.511816:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e7cc lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ca9 expref: 16 pid: 14397 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642449.511861:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 15 00000100:00100000:3.0:1788642449.511871:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+16:2359:x1875527086503552:12345-192.168.202.49@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788642449.511885:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788642449.511892:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e7cc lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ca9 expref: 16 pid: 14397 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.511906:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e7cc lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ca9 expref: 16 pid: 14397 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.511928:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dddc4dc4700) 00010000:00010000:3.0:1788642449.511933:0:14382:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.511942:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.511951:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.511969:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788642449.512021:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+16:2359:x1875527086503552:12345-192.168.202.49@tcp:103:ldlm_bl.0 Request processed in 152us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642449.512029:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 15 00010000:00010000:0.0:1788642449.513851:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9c00/0x4ae1ee156666e7cc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9ca9 expref: 15 pid: 14397 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642449.513873:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14397:1875527107458944:192.168.202.49@tcp:104: 00010000:00010000:0.0:1788642449.513896:0:14397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.513906:0:14397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.513912:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788642449.514527:0:14397:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788642449.514683:0:14397:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788642449.514737:0:14397:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788642449.514831:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14397:1875527107459072:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788642449.514892:0:14397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642449.514935:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5dc99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788642449.515144:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107459072 00000100:00100000:3.0:1788642449.515150:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107459072 00000100:00100000:3.0:1788642449.515209:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788642449.515218:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14397:x1875527107459072:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788642449.515308:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14397:x1875527107459072:12345-0@lo:1000:mdt00_002.0 Request processed in 90us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642449.515316:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788642449.515800:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14397:1875527107459072:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788642449.516644:0:14397:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788642449.516732:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14397:1875527107459200:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788642449.516988:0:14397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788642449.517024:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc5dc9000 going to sleep for 11 seconds 00000100:00100000:3.0:1788642449.517561:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107459200 00000100:00100000:3.0:1788642449.517569:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107459200 00000100:00100000:3.0:1788642449.517621:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788642449.517630:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14397:x1875527107459200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788642449.517977:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14397:x1875527107459200:12345-0@lo:1000:mdt00_002.0 Request processed in 346us (988us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788642449.517985:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788642449.518429:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa880700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14397:1875527107459200:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788642449.518605:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518616:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518625:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518632:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f8600 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642449.518636:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518644:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518658:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dddc4dc4700) 00010000:00010000:1.0:1788642449.518662:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788642449.518667:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518675:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f8600/0x4ae1ee156666e804 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518734:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e75c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518742:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e75c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518748:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e75c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518753:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494f000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:1.0:1788642449.518756:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e75c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518761:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e75c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518769:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:1.0:1788642449.518772:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788642449.518779:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e763 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c8d expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518861:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e763 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c8d expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518871:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e763 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c8d expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.518905:0:14397:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e1800/0x4ae1ee156666e763 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.49@tcp remote: 0xb7867eb9ad3a9c8d expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642449.518930:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14397:1875527107459328:192.168.202.49@tcp:105: 00000100:00100000:1.0:1788642449.519048:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dddc8c7cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788642449.524297:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642449.524369:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086503680 00000100:00100000:2.0:1788642449.524379:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086503680 00000100:00100000:2.0:1788642449.524434:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 10 00000100:00100000:2.0:1788642449.524444:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddc64e2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+19:14508:x1875527086503680:12345-192.168.202.49@tcp:49:dd.0 00000100:00100000:3.0:1788642449.524634:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14397:1875527107459328:192.168.202.49@tcp:105: 00010000:00010000:3.0:1788642449.524661:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e75c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524673:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494f000/0x4ae1ee156666e75c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524717:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e80b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524735:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e80b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524749:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e80b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524760:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e80b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524775:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e80b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524793:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e80b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524799:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494fa00 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642449.524804:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e80b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524811:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e80b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524823:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:3.0:1788642449.524827:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788642449.524830:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e80b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524837:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ddcc494fa00/0x4ae1ee156666e80b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524848:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e7fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524854:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e7fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524861:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e7fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524866:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9000 already unused, calling callback (ffffffffc1fb94f0) 00010000:00010000:3.0:1788642449.524875:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e7fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524882:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e7fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524890:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dddc4dc4000) 00010000:00010000:3.0:1788642449.524893:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788642449.524896:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e7fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.524902:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dde021f9000/0x4ae1ee156666e7fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642449.526595:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddc64e2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+19:14508:x1875527086503680:12345-192.168.202.49@tcp:49:dd.0 Request processed in 2142us (2298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788642449.526609:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 10 00000040:00080000:2.0:1788642449.527059:0:14427:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788642449.527064:0:14427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788642449.527093:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788642449.527125:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788642449.527366:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+18:14510:x1875527086503424:12345-192.168.202.49@tcp:57:lhsmtool_posix.0 Request processed in 21912us (22323us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788642449.527377:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 53 00000020:00080000:3.0:1788642449.527381:0:14397:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788642449.538629:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642449.538715:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086503936 00000100:00100000:2.0:1788642449.538725:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086503936 00000100:00100000:2.0:1788642449.538821:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 11 00000100:00100000:2.0:1788642449.538832:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+18:14510:x1875527086503936:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788642449.539526:0:14398:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788642449.539624:0:14398:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788642449.539664:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666e812 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.539681:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666e812 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.539693:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666e812 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.539710:0:14398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666e812 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.539724:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666e812 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.539731:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666e812 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.539757:0:14398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788642449.539842:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+20:14510:x1875527086503936:12345-192.168.202.49@tcp:35:lhsmtool_posix.0 Request processed in 1011us (1222us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788642449.539850:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 11 00000020:00080000:2.0:1788642449.539855:0:14398:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788642449.539920:0:15570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788642449.539927:0:15570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666e812 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.539934:0:15570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e0600 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642449.539939:0:15570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666e812 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.539947:0:15570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666e812 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.539960:0:15570:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dddc4dc4700) 00010000:00010000:1.0:1788642449.539963:0:15570:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788642449.539968:0:15570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666e812 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.539974:0:15570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dddfd6e0600/0x4ae1ee156666e812 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.539988:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642449.539990:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642449.539992:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788642449.666128:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788642449.678627:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642449.678669:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:2.0:1788642449.679000:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086504064 00000100:00100000:2.0:1788642449.679010:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086504064 00000100:00100000:0.0:1788642449.679331:0:15088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086504192 00000100:00100000:0.0:1788642449.679336:0:15088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086504192 00000100:00100000:0.0:1788642449.679374:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:0.0:1788642449.679563:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+8:2360:x1875527086504064:12345-192.168.202.49@tcp:4:dd.0 00002000:00010000:0.0:1788642449.679620:0:15088:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9c8490, atime: 0x6a9c848f, ctime: 0x6a9c8490, blocks: 0x1 00010000:00010000:0.0:1788642449.679630:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e819 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.679648:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=537s v=(0 0) 00010000:00010000:0.0:1788642449.679653:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642449.679660:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e819 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.679677:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e819 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642449.691538:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.691925:0:15086:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788642449.692009:0:15086:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788642449.700114:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086504320 00000100:00100000:0.0:1788642449.700127:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086504320 00000100:00100000:3.0:1788642449.700708:0:16629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 1 00000100:00100000:3.0:1788642449.700722:0:16629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+10:2360:x1875527086504192:12345-192.168.202.49@tcp:4:dd.0 00010000:00010000:3.0:1788642449.700762:0:16629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e820 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.700781:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642449.700785:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642449.700792:0:16629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.700807:0:16629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788642449.795012:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1788642449.795037:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:2.0:1788642449.795044:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:1.0:1788642449.795061:0:15088:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1788642449.795066:0:15088:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788642448 -> 1788642449 00002000:00010000:1.0:1788642449.795084:0:15088:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1788642449.795126:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e819 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.795140:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e819 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.795149:0:15088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e819 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.795156:0:15088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9c00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642449.795160:0:15088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e819 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.795171:0:15088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e819 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.795193:0:15088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e819 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.795200:0:15088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e819 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642449.795295:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+10:2360:x1875527086504064:12345-192.168.202.49@tcp:4:dd.0 Request processed in 115908us (116671us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788642449.795324:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 0 00000100:00100000:1.0:1788642449.795367:0:15088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:1.0:1788642449.795380:0:15088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddef17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:2360:x1875527086504320:12345-192.168.202.49@tcp:4:dd.0 00010000:00010000:1.0:1788642449.795420:0:15088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e827 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.795431:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642449.795435:0:15088:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642449.795441:0:15088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.795453:0:15088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788642449.842773:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:0.0:1788642449.845620:0:16629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1788642449.845630:0:16629:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:0.0:1788642449.845659:0:16629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.845671:0:16629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.845680:0:16629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e820 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.845687:0:16629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494f400 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642449.845692:0:16629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e820 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.845709:0:16629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e820 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.845730:0:16629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e820 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642449.845738:0:16629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e37f39b/0x4ae1ee156666e820 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642449.846061:0:16629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:2360:x1875527086504192:12345-192.168.202.49@tcp:4:dd.0 Request processed in 145336us (167384us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788642449.846072:0:16629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 1 00000001:00080000:2.0:1788642449.889069:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:1.0:1788642449.889689:0:15088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.889715:0:15088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e827 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.889724:0:15088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e827 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.889732:0:15088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffaa000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642449.889737:0:15088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e827 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.889746:0:15088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e827 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.889787:0:15088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e827 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.889795:0:15088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e9f7a7c/0x4ae1ee156666e827 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642449.889904:0:15088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddef17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2360:x1875527086504320:12345-192.168.202.49@tcp:4:dd.0 Request processed in 94523us (198371us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788642449.889915:0:15088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 2 00000100:00100000:0.0:1788642449.901447:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.901488:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.901542:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642449.901571:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642449.901747:0:16629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086504448 00000100:00100000:3.0:1788642449.901758:0:16629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086504448 00000100:00100000:3.0:1788642449.901819:0:16629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086504576 00000100:00100000:3.0:1788642449.901822:0:16629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086504576 00000100:00100000:3.0:1788642449.901836:0:16629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086504704 00000100:00100000:3.0:1788642449.901838:0:16629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086504704 00000100:00100000:3.0:1788642449.901848:0:16629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086504832 00000100:00100000:3.0:1788642449.901851:0:16629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086504832 00000100:00100000:3.0:1788642449.901868:0:16629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:3.0:1788642449.901878:0:16629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+8:2360:x1875527086504448:12345-192.168.202.49@tcp:4:dd.0 00002000:00010000:3.0:1788642449.901942:0:16629:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9c8491, atime: 0x6a9c848f, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1788642449.901953:0:16629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000033b3cdc/0x4ae1ee156666e82e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.901969:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=537s v=(0 0) 00010000:00010000:3.0:1788642449.901974:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788642449.901981:0:16629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000033b3cdc/0x4ae1ee156666e82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788642449.901995:0:16629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000033b3cdc/0x4ae1ee156666e82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642449.902366:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:2.0:1788642449.902377:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:2359:x1875527086504576:12345-192.168.202.49@tcp:4:dd.0 00010000:00010000:2.0:1788642449.902396:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666e835 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.902405:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642449.902408:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788642449.902412:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666e835 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642449.902435:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666e835 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788642449.919899:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:1.0:1788642449.934759:0:15087:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788642449.934776:0:15087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1788642449.935021:0:15087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086504960 00000100:00100000:1.0:1788642449.935030:0:15087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086504960 00000100:00100000:1.0:1788642449.938314:0:16631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 5 00000100:00100000:1.0:1788642449.938350:0:16631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:adce0da7-4d4d-46cf-bea0-9514c5720b94+15:2360:x1875527086504704:12345-192.168.202.49@tcp:4:dd.0 00010000:00010000:1.0:1788642449.944313:0:16631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b68a9d8/0x4ae1ee156666e83c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.944350:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642449.944355:0:16631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642449.944362:0:16631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b68a9d8/0x4ae1ee156666e83c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.944378:0:16631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b68a9d8/0x4ae1ee156666e83c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788642449.986877:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1788642449.997080:0:16629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:1.0:1788642449.997090:0:16629:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788642449 -> 1788642450 00002000:00010000:1.0:1788642449.997094:0:16629:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788642450 00002000:00010000:1.0:1788642449.997107:0:16629:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:1.0:1788642449.997123:0:16629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000033b3cdc/0x4ae1ee156666e82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.997137:0:16629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000033b3cdc/0x4ae1ee156666e82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.997146:0:16629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000033b3cdc/0x4ae1ee156666e82e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.997154:0:16629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ddcc494fa00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:1.0:1788642449.997159:0:16629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000033b3cdc/0x4ae1ee156666e82e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.997169:0:16629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000033b3cdc/0x4ae1ee156666e82e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.997191:0:16629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000033b3cdc/0x4ae1ee156666e82e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.997200:0:16629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000033b3cdc/0x4ae1ee156666e82e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788642449.997324:0:16629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+15:2360:x1875527086504448:12345-192.168.202.49@tcp:4:dd.0 Request processed in 95443us (95883us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788642449.997345:0:16629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 3 00000100:00100000:1.0:1788642449.997381:0:16629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 6 00000100:00100000:1.0:1788642449.997393:0:16629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc6339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+14:2359:x1875527086504832:12345-192.168.202.49@tcp:4:dd.0 00010000:00010000:1.0:1788642449.997424:0:16629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055d10af5/0x4ae1ee156666e843 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.997436:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642449.997441:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788642449.997447:0:16629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055d10af5/0x4ae1ee156666e843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788642449.997458:0:16629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055d10af5/0x4ae1ee156666e843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788642450.064082:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:2.0:1788642450.064123:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1788642450.064454:0:15086:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:0.0:1788642450.064471:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666e835 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.064485:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666e835 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.064505:0:15086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666e835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.064513:0:15086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddfd6e1000 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642450.064518:0:15086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666e835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.064527:0:15086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666e835 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.064547:0:15086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666e835 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.064556:0:15086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005598a8a5/0x4ae1ee156666e835 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642450.064654:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+12:2359:x1875527086504576:12345-192.168.202.49@tcp:4:dd.0 Request processed in 162274us (163161us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788642450.064676:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 4 00000100:00100000:0.0:1788642450.064714:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:0.0:1788642450.064725:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+11:2359:x1875527086504960:12345-192.168.202.49@tcp:4:dd.0 00010000:00010000:0.0:1788642450.064753:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e84a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.064765:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642450.064769:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788642450.064775:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e84a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.064786:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e84a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788642450.085752:0:16631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1788642450.085763:0:16631:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1788642450.085783:0:16631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b68a9d8/0x4ae1ee156666e83c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.085796:0:16631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b68a9d8/0x4ae1ee156666e83c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.085806:0:16631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b68a9d8/0x4ae1ee156666e83c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.085813:0:16631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffab200 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642450.085834:0:16631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b68a9d8/0x4ae1ee156666e83c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.085845:0:16631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b68a9d8/0x4ae1ee156666e83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.085866:0:16631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b68a9d8/0x4ae1ee156666e83c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.085874:0:16631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b68a9d8/0x4ae1ee156666e83c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642450.086169:0:16631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:adce0da7-4d4d-46cf-bea0-9514c5720b94+13:2360:x1875527086504704:12345-192.168.202.49@tcp:4:dd.0 Request processed in 147834us (184618us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788642450.086179:0:16631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 5 00000001:00080000:2.0:1788642450.110061:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:0.0:1788642450.112574:0:16629:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1788642450.112598:0:16629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055d10af5/0x4ae1ee156666e843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.112612:0:16629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055d10af5/0x4ae1ee156666e843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.112621:0:16629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055d10af5/0x4ae1ee156666e843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.112629:0:16629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dddeffab400 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:0.0:1788642450.112634:0:16629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055d10af5/0x4ae1ee156666e843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.112654:0:16629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055d10af5/0x4ae1ee156666e843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.112676:0:16629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055d10af5/0x4ae1ee156666e843 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788642450.112684:0:16629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055d10af5/0x4ae1ee156666e843 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788642450.112791:0:16629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc6339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:adce0da7-4d4d-46cf-bea0-9514c5720b94+9:2359:x1875527086504832:12345-192.168.202.49@tcp:4:dd.0 Request processed in 115395us (211211us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788642450.112802:0:16629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 6 00000001:00080000:2.0:1788642450.141180:0:6736:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:2.0:1788642450.141575:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e84a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642450.141591:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e84a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642450.141601:0:15086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e84a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642450.141608:0:15086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dde021f9c00 already unused, calling callback (ffffffffc15aa4f0) 00010000:00010000:2.0:1788642450.141613:0:15086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e84a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642450.141623:0:15086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e84a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642450.141643:0:15086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e84a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788642450.141667:0:15086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052624dc7/0x4ae1ee156666e84a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788642450.141825:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2359:x1875527086504960:12345-192.168.202.49@tcp:4:dd.0 Request processed in 77098us (221931us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788642450.141837:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 7 00000100:00100000:0.0:1788642450.587904:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642450.587945:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642450.587983:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642450.588012:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642450.588034:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642450.588051:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:0.0:1788642450.588090:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.49@tcp (source: 12345-192.168.202.49@tcp) 00000100:00100000:3.0:1788642450.588182:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086505088 00000100:00100000:3.0:1788642450.588192:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086505088 00000100:00100000:3.0:1788642450.588250:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 124 00000100:00100000:3.0:1788642450.588260:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:2362:x1875527086505088:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642450.588349:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:90ca42bc-d1c2-4691-baf3-de9911d6e83e+13:2362:x1875527086505088:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 90us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642450.588357:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 124 00000100:00100000:3.0:1788642450.588419:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086505344 00000100:00100000:3.0:1788642450.588423:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086505344 00000100:00100000:3.0:1788642450.588442:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086505856 00000100:00100000:3.0:1788642450.588444:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086505856 00000100:00100000:3.0:1788642450.588462:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086505472 00000100:00100000:3.0:1788642450.588464:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086505472 00000100:00100000:3.0:1788642450.588479:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:3.0:1788642450.588485:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ddcc633bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2362:x1875527086505344:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642450.588512:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ddcc633bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2362:x1875527086505344:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 28us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642450.588518:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 16 00000100:00100000:3.0:1788642450.588529:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:3.0:1788642450.588534:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:2362:x1875527086505856:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642450.588555:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:2362:x1875527086505856:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 21us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642450.588561:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 17 00000100:00100000:3.0:1788642450.588572:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:3.0:1788642450.588578:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2362:x1875527086505472:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642450.588600:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:adce0da7-4d4d-46cf-bea0-9514c5720b94+5:2362:x1875527086505472:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 22us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642450.588606:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 18 00000100:00100000:3.0:1788642450.588633:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086505600 00000100:00100000:3.0:1788642450.588643:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086505600 00000100:00100000:3.0:1788642450.588673:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086505216 00000100:00100000:3.0:1788642450.588676:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086505216 00000100:00100000:3.0:1788642450.588705:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:3.0:1788642450.588712:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:2362:x1875527086505600:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642450.588744:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+6:2362:x1875527086505600:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 33us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642450.588750:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 29 00000100:00100000:3.0:1788642450.588761:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00100000:3.0:1788642450.588766:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+20:2362:x1875527086505216:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642450.588789:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:adce0da7-4d4d-46cf-bea0-9514c5720b94+20:2362:x1875527086505216:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 23us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642450.588795:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 30 00000100:00080000:1.0:1788642450.589133:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788642450.589139:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788642450.589826:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527086505728 00000100:00100000:3.0:1788642450.589832:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527086505728 00000100:00100000:3.0:1788642450.589881:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00100000:3.0:1788642450.589889:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:2362:x1875527086505728:12345-192.168.202.49@tcp:400:kworker.0 00000100:00100000:3.0:1788642450.589958:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f5c02b1-d686-4a38-a2ab-587c307d3c0a+5:2362:x1875527086505728:12345-192.168.202.49@tcp:400:kworker.0 Request processed in 69us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642450.589965:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.49@tcp, seq: 19 00000100:00080000:1.0:1788642450.590656:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788642450.682332:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788642451.621823:0:16668:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788642451.707258:0:15570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788642452.668442:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788642452.668465:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107459456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788642452.668537:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642452.668613:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107459456 00000100:00100000:3.0:1788642452.668621:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107459456 00000100:00100000:3.0:1788642452.668696:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788642452.668707:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107459456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788642452.668743:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788642452.668790:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875527107459456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642452.668798:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788642452.668819:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788642452.668845:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788642452.668850:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dddc4e34380, transno 8589934595 00000004:00080000:3.0:1788642452.668860:0:3317:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788642452.668893:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1875527107459456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788642452.731532:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788642453.179221:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788642453.179244:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfad38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107459584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788642453.179313:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642453.179662:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107459584 00000100:00100000:3.0:1788642453.179680:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107459584 00000100:00100000:3.0:1788642453.179741:0:15084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788642453.179750:0:15084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107459584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788642453.179787:0:15084:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788642453.179838:0:15084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875527107459584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642453.179845:0:15084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788642453.179866:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788642453.179903:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfad38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1875527107459584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788642453.179991:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107459840:0@lo:400:kworker.0 00000100:00100000:3.0:1788642453.180023:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642453.180047:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788642453.180053:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107459968:0@lo:400:kworker.0 00000100:00100000:3.0:1788642453.180076:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642453.180145:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107459840 00000100:00100000:3.0:1788642453.180150:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107459840 00000100:00100000:3.0:1788642453.180175:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107459968 00000100:00100000:3.0:1788642453.180179:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107459968 00000100:00100000:1.0:1788642453.180347:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107460096:0@lo:400:kworker.0 00000100:00100000:1.0:1788642453.180384:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788642453.184984:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788642453.185005:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dddfa8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107459712:0@lo:400:kworker.0 00000100:00100000:1.0:1788642453.185094:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788642453.191441:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107460096 00000100:00100000:3.0:1788642453.191459:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107460096 00000100:00100000:3.0:1788642453.191920:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788642453.191934:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107459840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642453.192036:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875527107459840:12345-0@lo:400:kworker.0 Request processed in 107us (12012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642453.192044:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788642453.192066:0:16274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788642453.192073:0:16274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfa880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107459968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642453.192125:0:16274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfa880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875527107459968:12345-0@lo:400:kworker.0 Request processed in 53us (12048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642453.192132:0:16274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788642453.192153:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788642453.192165:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875527107459712 00000100:00100000:3.0:1788642453.192170:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875527107459712 00000100:00100000:0.0:1788642453.192326:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1875527107459968:0@lo:400:kworker.0 00000100:00100000:0.0:1788642453.192357:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875527107459840:0@lo:400:kworker.0 00000100:00100000:3.0:1788642453.192412:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788642453.192421:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddeff85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3319:x1875527107459712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642453.192470:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddeff85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:228e481e-56eb-4de3-bc1a-1dbb71f0c898+19:3319:x1875527107459712:12345-0@lo:400:kworker.0 Request processed in 51us (7376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642453.192476:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788642453.192536:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788642453.192649:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:228e481e-56eb-4de3-bc1a-1dbb71f0c898:3319:1875527107459712:0@lo:400:kworker.0 00000100:00100000:3.0:1788642453.192707:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dddfad1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107460096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788642453.192782:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dddfad1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875527107460096:12345-0@lo:400:kworker.0 Request processed in 77us (12397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788642453.192795:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788642453.192810:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788642453.196031:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dddfa8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1875527107460096:0@lo:400:kworker.0 Debug log: 29974 lines, 29974 kept, 0 dropped, 0 bad.